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Abstract 



A national ran^dom sample of over 14 ,000 high schOQl seniors was 
studied with respect to socio-cultural differan'^es in responses to 
cognitive test items. Six different cognitive tests and ten differ- 
ent groups were analyzed. The tests werei vocabulary, picture-'number, 
reading, letter-^groups, mathematics i and mosaic comparisons* The 
groups werei Ajnerican Indians,, Blacks, Mexiean-AmericanSs Puerto 
Ricans, Other Latin-^Americans, Oriental-Americans, White Northeastern, 
White North Central, I^ite Southern, and White Western. Proportions 
of each group responding correctly to each item of each test were com- 
puted and then transformed to an interval scale of delta-valuea * The 
delta-values for the White North Central group were then cross-plotted 
with each of the other groups to yield an elliptical pattern of points 
for each comparison. The major axis of the ellipse for each cross^plot 
was determined and Che distance of each item^point from it comiputed. 
These distances were used to create a vector index of cross-cultural 
stability. Itemp having notable patterns of instability were examined 
closely for factors which might eKplaln such an outcome. 

The greatest instabilities were noted among the vocabulary items. 
These vocabulary instabilities appeared to be attributable to linguistic 
differences, primarily Chose exis'tlng between Spanish-speaking groups 
and other groups* Vocabulary items Involving cognates were easier for 
the higher socio-economic status Spanish'-speaking groups than for the 
l^Hiite North Central group* It was also observed that reading test items 
having material relevant to black culture were relatively easier for 
blaclcs than were other Items in the tost battery. A perhaps significant: 

. 4 



finding occurred in the analysis of flathematice items. The Index com- 
puted revealed classes of items especially difficult for minorities 
and especially easy for minorities (relative to their performance on 
other portions of the test battery), / >te theTnatlcal knowledge obtainable 
from everyday life situations^ such as li:'W to count money, were relative^ 
ly less difficult for minority groups. In contrast ^ very slmplf^ math- 
eniatlcal problems* such as determtntng the value of square roots of whole 
numbers less than ten, seemed extraordinarily difficult for minority groups. 
Since such knowledge^ though easily obtained, is usually only obtained in 
a school setting, what is suggested is that most minority groups In the 
United States receive seriously deficient schooling In mathematics. 
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The research reported in this paper was supported in its entireCy 
by a Sn^ll Grant from tha National Institute of Education's Field 
Initiated Studies Program, Because of the limited funding associated 
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nature* The present study is only an eKploration into the complex 
problem of testing in a pluralistic society. Rather than being a 
con^prehensive analysis^ the study Is intended merely to suggest a 
new way of thinking about test use and construction. While the data 
used for the study have the potential for much more exhaustive anal- 
ysis, such exhaustive analysis was not possible. 
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Introduction 



There is a conviction among many members of ethnic minority groups 

and Qthers that traditional tests of acadeTnic achievement and tests used 

for employmant decisions are biased In favor of a white middle^class culture. 

Although niuch research tends to discount such a belief Ce.g*s Stanleyj 1971; 

Cleary, 1968; Rock, 1970; Campbell^ Crooks, Mahoneys and Rock^ 1973), there 

is no doubt that some items on some tescs are more difficult for some socio- 

cultural groups* This point was emphasised by Green and Draper (1972) i 

As a matter of fact we do know that most academic tests, both 
aptitude and achievement, yield consistently higher scores for one 
set of groups in society in contrast to various other groups such 
as poor people, blacks , and Chtcanos (Coleman, 1966). Some people 
overgeneralize these results to indicate that the latter groups are 
inferior to the former. In so doing they are assuming the tests are 
fair and unbiased. [p, 5] 

What the words "fair" and "unbiased'* mean, however, has proven to be diffi- 
cult -to define. Green and Draper note* 

A biased test is popularly understood to be a test which is 
unfair to identifiable subgroups of the general population in which 
it is being used. Although many people seem to believe the matter 
is simple, little is actually known about the nature of bias in tests 
and even the most widely accepted propositions badly need verification, 
[p^ 1] 

This kind of confusion led Darlington (1971) to propose that the concept of 

"cultural fairness" be replaced by a concept of "cultural optimality." No 

terminology, however, replaces the need for a careful consideration of the 

way in which a specific test (or portion thereof) is used* In the words of 

Thorndlke (1971) : 

Since there are many dirferent u-^cj& that can be made of a 
particular test or inferences that can be based upon it, it is 
entirely possible that one use or inference is fair while another 
is grossly unfair. [p. 63] 

As an example of unfair test use, Thorndike presented the following hypothetical 



item I 
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The usual temperature for baking a cake is about i 

(A) 250^ (B) 300^ (C) 350^ (D) 400^ 

In terms of the proportiun of correct responses that would probably be obtained 

ware such an item administered, the item would seem unfair to tnales , since they 

spend less time cooking than do femnles* Thus, if this item ware used as part 

of a college admissions test* it would clearly seem inappropriate. But if it 

were used as part of a test to select persons for employment as bakers, then 

the item would at least have face validity* 

Rather than considering individual items * the more common approach has 

bean to rm .idar entire tests, Attempted statistical definitions of test bias 

have been approached by two basically different methods i those using criteria 

external co the test, and those using only Internal criteria (Potthoffj 1972)* 

Methods employing external criteria generally involve use of test scores for 

prediction of some future success* Cleary (1968) has provided a widely ac-- 

cepted definition of test bias which compares regression equations of test 

scores on criterion for different groups , She states: 

A test is biased for members of a subgroup of the population 
if 4 in the prediction of a criterion for which test was designed^ 
consistent nonzero errors of prediction are made for members of 
the subgroup* In other words, che test is biased if the criterion 
score predicted from the common regression line is 'consistently 
too high or too low for members of the subgroup* With this'defi" 
nltion of biasj there may be a connotation of "unfair^" particu- 
larly if the use of the test produces a pradiction that is too 
low, 

Thorndike (1971) demonstrated that a test which would be fair by Cleary 's 
definition may be unfair by another standard. He has shown that when mean 
differences between two groups on the predictor are large relative to mean 
-differences on the criterion, even when regression lines for the two groups 
are equal, the test would select a Hmailer proportion of the low scoring 
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group than the proportion who actually could have been successful on the 
criterion. According to Thorndiks (1971) a fair test must select a pro= 
portion of the minority group which is equal to the proportion who would 
actually succeed on the criterion. This may necessitate the lowering of 
critical cut-^off. points for selection for some minority groups. 

Cole (1972) approaches test bias by eKamining decision errors for 
various groups* The proportion of false positives (those with acceptable 
predictor scores and unacceptable criterion scores) to false negatives 
(those with unacceptable predictor scores and successful criterion scores) 
should be the same in all groups if ^the test is "fair." 

Comparative studies of these and other definitions of test bias (Linn, 
1973; Darlington, 1971) show that the previously mentioned approaches are 
cpntradlGtory . The enigmas encountered in the external criterion approach 
have been clarified somewhat by Reilly (1973). A test which may be fair 
by one definition may be unfair by another. Therefore, a sinsle statisti- 
cal solution to the problem of test bias derived from the comparison of 
tests to an external criterion seems impossible. ConBidering that the 
external criterion , itself , may be biased (see Campbell, et al.,1973) 
leads one to question this entire approach. Both Darlington (1971) and 
Linn (1973) conclude that statistical solutions alone are not sufficient 
to solve the test bias problem— some value judgments must be made. 
Darlington proposes the concept of the "culturally optimal test" which 
balances cultural dif f erantiation with validity and which employs both 
subjective policy level decisions and empirical statistical information. 

An alternate approach to the definition of cultural bias attempts . 
to make some statistical statement about the items in a test without 
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rinformaUion other cM that obtainable from the test items themselves . The 

- V ^methods used by Claary and Hiltan (1968) , Echcern/icht (1972a, 1972b) , Angoff 
and Ford (1973), Ango^f (1972) ,Angoff and MoUu (1973) , and Cardall and Coffman 

: (1954) . essentiaily compar^^ across cultural groups. Those 

/.items which are either unusually easy or unusually difficult for one group in 
relation to another group are examined* If many items are unusual across 
several grDup comparisons , the test may be called biased* l^ilc? these studies 
are labeled studies of "item bias," they rarely attempt to analyse sources of 
deviation for outstanding items* The attempt has been usually to make some 
infterence about the test as a whole by demonstrating the existence or lack of 
existence of a significant item -x^group interaction. Individual items are 
not considered in a subjective sense nor are the possible sources of bias in 

^ any one Individual item explored with any depth. 

Those few papers that do consider individual items most often attempt to 
: define some mechanical prQcedure with which "biased" items" may be detected, 

\v Given the importance of the use to which items (or entire tests) are put, no 
entirely mechanical procedure would seem likely to gain acceptance. It is 
the objective of the present study to explore the problem of cross-eultural 
stability of test items with a combined mechanical and sub j ective approach 
in much the same way as Darlington combined the mechanical and subjective 
in thinking about entire tests. The procedure ISs first, to compute an index 
(mechanically) which is useful In detecting especially unstable items and 

^ 'then to apply subjective analyses to determine what, if anything, character--^ 
Izes these items. Similarly, items may also be detected because of their 

■ appaTent stability. Subjective j udgments are then used to characterize these 
items - ■;■ 
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■ - The procedure used is similar to that used by Angpff and Ford (1971) • 

They compared several samples of black and white students drara from tha 

1970 PSAT (Preliminary Scholastic Aptitude Test) administration in Georgia. 

Item analyses were conducted for each sample and item difficulty croys-- 

plotted for pairs of samples. As a measure of item x group interaction, 

they used the correlation of item difficulties (the lower the correlation, 

the more the interaction) , Angoff and Ford concluded that the findings 

were sufficiently provocative to deserve more detailed study. Like the 

cross-plots of Cleary and Hiitpn, those of Angoff and Ford also 

a number of Items that appeared to be especially difficult for blacks. 

togoff and Ford suggested a need for studies with larger samples than those 

they had used. This remark of theirs Is of special interest: 

Further editorial examination of the items that were especially 
harder for the blacks suggested^ as one would expect, particular 
dif ficulties with vocabulary and concepts pertaining to unfamiliar ^ 
places and experiences, and possibly also to confusion with sp 
meanings and significances characteristic of the ghetto. 

The same kinds of phenDmena ware discussed by Taylor (1971) in an 

entirely dif£erent context (that of speech difficulties) and;from a different 

disciplinary vie^^oint (sDcio-^linguistlcs) . Deemphasizing the importance of 

the ghetto . Taylor traced the evolutionary history of Black English and showed 

how, because of a different long-term cultural development , Black English is^ 

very different from what is sometimes called Standard English. The position 

of Taylor is Important in that it challenges the so-called social deprivation 

theory (that blacks simply have underdeveloped language and cognitive abil^ 

ities) by emphasiEing that Black English (implying a language more deeply 

rooted than "hip talk") is very different from Standard English. Taylor 

also indicated that there are probably several types of Enilish among whites 
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living in the continental United States. Southern White English has strong 

similarities to Black English; however, Standard English is very different 

from either Black English or Southern VJhite English. Since it is well known 

that white southerners also tend to score low on standard achievement tests, 

this observation of Taylor Is especially noteworthy. 

... . .,• ~^ '~j 

If strong differences exist between Black English and Standard English ^ 

and even among: different types of American English, then the linguistic pat- 
terns of American Indians j Hexican-toer leans , Puerto RlcanSj and Oriental^ 
Americans might be expected to differ as well, Armstrong (1972) had members 
of several ethnic groups rate test items as to the degree chey believed them 
to be biased against their group* Within ethnic groups, he found surprising 
agreement on which items were biased. But the Items considered to be biased 
varied considerably from one ethnic group to another. Accordingly, Armstrong's 
research would support Taylor's theory, Armstrong, however j conducted no 
analyses of data from test administrations for these different ethnic groups. 

A recently collected, and extensive, set of data has afforded the oppor= 
tunity for conducting the present study* These data are those from the 
National Longitudinal Study of the High School Class of 1972*^ In this 
sample of over I75OOO high school students , special attention was paid to 
the problem of insufficient numbers of cases for minorities so that adequate 
data were obtained for analyses relating to minorities/ With such a large 
number of cases and detailed classifications by ethnic group, regions and 
other identifying criteria, these data are ideal for the study of the problem 
of cross-cultural stability of test items* The cognitive tests used in the 

^Conducted for the U,S* Office of Education by the Educationai Testing Service 
under Contract No. EC-0-72-^0903 . ' " 




National Longitudinal Study (NLS) cover a range of abilities and item 
prasentation styles, Moraovar, tha care with which the sample was taken 
offers the potentiality of generalization to the nation as a whola. 

An exploratory developmant of a procedura for computing an index of 
cross-cultural stability was conducted. Soma characteristics of items so 
datacted, obtained from a subj active analyses of the ItemSj are presented* 
Tha possibility of using the same technique, cumulatively, to dascribe 
entira tests with respect to their cross-cultural stability is also consid-' 
arad. Beyond a briaf considaration of the causal factors underlying the 
itam instabilities presented ^ a need exists for generalizations about these 
causal factors. It is believed that these generaliEations are best attempted 
by those who belong to the specific socio-eultural group to which the insta- 
^^''llties relate or by those, such as socio-llnguists, who have studied such 
problems* Accordingly, it is hoped that the ethntc scholars and others to 

.... 4 

whom this report is being disseminated will attempt these generalizations. 



16 



^8- 



The Sample 

The data used in the project were racently collected as a part of the- 
NLS^ This study was based on a stratified two=stage probability sample. 
Schools were selected nationwide 5 with knoWA probabilities ^ by WESTAT Cor- 
poration, from universe listings of schools ratained by the U, S* Office 
of Education, The population was stratified by a set of eight variables- 
(1) public or nonpublic, (2) geographic region, (3) enrollment size clasSs 
(4) proximity to institutions of higher education, (5) percent minority , 
(6) incoine level of the community around the sc- (7) school type- 

where Type A represented schools of low Income or high minority classi- 
ficatlonj and Type B represented all others—and (8) degree of urbanization 
Altogethers 600 final strata were defined and Type A schools were selected 
at Twi c e tlie ^ s amp liTig rate of Type B schools to produce a final sample of 
1,200 schools, two from each final stratum. 

. Within eabh -.cooperating sample school ^ a random sample of studeiits In 
grade 12 (or its equivalent) was taken by Educational Testing Service from 
lists of all such students provided by the school. Where possible ^ 18 
students were selected* Occasionally , noncooperatlng students or small 
school enrollments rasulted in fewer than 18 students being Included in 
the final sample. 

A few kinds of schools and students were excluded from the study. 
Excluded schools consisted mostly of schools for physically or mentally 
handlbapped students, schools for legally confined students, and schools 
which did not enroll students of their oto (such as area vocational schools 
having students enrolled in other schools) * Included schools were required 
to br within the 50 states and the District of Columbia, Excluded studants 



consisted early gradyates, adult sducation students , and etudents who in 
the view of their school would be harmed by participating in the study. 
The final count of students involved in the study was 17s726j and these 
represented 1,044 different high schools of the targeted sample of 1200 
schools • 
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Inatruments 



The instruments examined were those used in the National Longitudinal 
Study Sample. A sample of item-type8 from the battery and the answer sheet 
used in responding are included as Appendix A. Further details of procedures 
used are provided -■..••lugh the Survey Administrators Guide , Appendix B (giving 
the procedures used in administering the test) . The sequenitlal order of 
the tests, described in detail below, was- Vocabulary, Picture^Number, 
Reading, Letter Groups, Mathematics, and Mosaic Comparisons. This sequerlca 
was chosen because it interspersed the three more conventional and the 
three more novel tests, an arrangement that provides Interest and motiva- 
tion for the examinees. Vocabulary was chosen for the first position be= 
cause of the inherent simplicity of this test's format and directions. At 
the outset, it was bellaved that the Vocabulary Test should build the con- 
fidence of the students in their capability to perform well. Because it 
is quite speeded, Moidaic eomparisons was. placed last to prevent any anxiety 
that might be engendered by this speededness from persisting In later test 
sections . 

The composition of the NLS battery represented a balancing of somewhat 
opposing considerations. The primary objective was to obtain a comprehensive 
description of persons whose backgrounds, ethnic affiliations, and socio- 
economic status are quite diverse. At the same time, the need for various 
measures had to be balanced with the requirement of using a battery of 
reasonable length. Lengthy tests are a nuisance to schools that must 
schedule time to administer them and to students who must endure them 
-without significant fatigue or loss of interest. For this reason, the 
battery was held to 69 minutes of testing time plus 36 minutes of 
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" administrative time for a total of 105 minutes* Table 1 provides a summary 
of the properties of the battery* - 

An ETS optical scanning system (SCRIBE) was used in processing the 
test answers, which students entered on a separate answer sheet (Appendix 
i A)* This process thus matntained a uniform procedure with previous use of 
the test components, rather than introducing another process variable by 
having students indicate answers by some other procedures such as circling 
or directly marking answers in test books* 

To conserve testing time, some of the tests used in the NLS battery 
were shorter than the parent versions from which they were derived. The 
tests were originally designed to yield reliability coefficients appro^ 
prlate for use with Individual students. However, the tests used in NLS 
were not intended for making decisions about Individuals; rather^ they 
were used as group measures, wherein the reliability of the mean scores 
for various samples or subgroups was the critical consideration* In such 
situations J the error variance of a mean is only l/H^^ the error variance 
associated with an individual score* Thus, the tests in the battery, with 
estimated reliabilities ranging from ,70 to ,85, yield highly reliable 
measurements 'of the mean. A brief description of each test section and 
a suBmary of its psychometric properties follows* 

Vocabulary * A brief test using synonym format consisting of items 
drawn from the longer Project Access Vocabulary Test, The 15 items selected 
were intended to avoid- academic or collegiate bias and to be of an appro- 
priate level of difficulty for the NLS twelfth grade population. Verbal 
ability is known to be related to performance in most academic pursuits 
as well as professional and semlprof essional occupations* The straight^ 
forward vocabulary synonyrfi test is the best and most well^documented 

% ''■ ■..„, .22': ■.• 



measure of this verbal ability. Evidence for the predictive validity of 
the Vocabulary Test is given in Table 2. Median correlatidns between 
Vocabulary Test scores and first-^term grade^point averages of students 
enrolled in various curriculums within two-year community colleges are ! 
in the range of ,2 to *4. The Vocabulary Test has also been related to 
subsequent perfomance in specific entry^level English courses at com- 
munity colleges (Ford j 1970); The median correlation represented between 
the Vocabulary Test and freshman English courses within 38 community col'- 
leges was .26 with a range of validity of .08 to ,40, depending upon the 
specific college considered. ^ 

P i c t ure-Numbe r ^ Consists of a series of drawings of familiar objects j 
each paired with a number. The student^ after studying the picture-^number 
pairs, is asked to recall the number associated with each object. This 
test appeared in both the CGP and Project Access batteries. The inclusion 
of the Picture-Number Test represents acknowledgment of a line of research 
tha:; suggests that populations low in economic status have relatively higher 
mean scores in asspciative memory than in other types of ability (Semler ^ 
Lscoe, 1963; Rohwer, et al.^ 1968; Jensen, 1969)* Further , recent ^theoreti- 
cal developments would suggest that such abilities can be utilized in- 
creasing the school achievement of this same group (Rohwer , 1971) Pre- 
diccive validity information is not currently available. However, th^ test 
does luive face validity based on the references cited above* * 

Reading > Based on short passages (100-200 words) with several related . 
qut^Btions concerning a variety of reading skills (analysis, interpretation) 
but focusihg on straightforward comprehension. The RGading Test draws upon 
items of particular relevance to minority group students taken from the 
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community collages was found betwaen the Letter Groups Test and freshman 
grada performance in occupacional^technical prograras in business (Table 2). 

Ma themat i^s > Consists of quantitative comparisons in which the student 
indiGates whether two' quantities are unequal (and which is greater) , equal 
or not ascertainable from the information given* This type of item is 
relatively quickly answered and provides Tneasurement of basic competence 
in mathematics while minimizing the amount of tina required for actual 
computacion. The test is a shortened version of widely used instru- 
ments but omits those items that tap algebraic ^ geometric , or trigouomatric 
skills* The parent test from which the NLS Mathematics Test was derived 
shows potency in predicting community college course grades (Ford, 1970)* 
In addition j the predictive validity of the SAT (Scholastic Aptitude Test) and 
mathematics scores in the NLS battery may be linked , as has been thoroughly 
documented (Angoff, 1971)* 

Mosaic CQmp^risonS i. Measures perceptual speed and accuracy through 
items which require that small differences be detected between pairs of 
otherwise identical mosaics or tile-like patterns* A deliberately speeded 
testj it has three separately timed sections consisting of increasingly inorr 
compleK mosaic patterns. Mosaic Comparisons represents ancther of the funda- 
mental measures used in many studies of aptitudes among minority groups* 
Tests like this which represent the spatial/perceptual domain seem, more 
than tests in the other domains considered, to allow students from minority 
groups an opportunity to perform better than they might otherwise* The 
Mosaic Comparisons Test, unlike many other spatial/perceptual scanning 
measures J is simple for che student to understand. Its predictive validities 
with performance in occupational^technical two-year career and one^year 
career business programs at the community college level were .28 and *42 
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respectively. These correlations represent median values across a nuTnber 
of different colleges* In addition to predictive validity in the career 
business area, the Mosaic Comparisons Test has shown a median correlation 
of ,23 with the freshman grade performance of students enrolled in college 
parallel fine arts curriculum. 
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Method 



The sample was first divided into ten mutually exclusive groupingB 



as follows * 




1. 


American Indian 




2, 


Black or Afro^-American or Negro 


3, 


Mexicans-American or Chicano 




4. 


Puerto Rican 




5 . 


Other Latin-Ainerican or of Spa 


nish Origin 


6, 


Oriental or Asians-American 




7/ 


Northeastern .^ite or Caucasia 


n 


8, 


Southern White or Caucasian 




9. 


North Central White or Caucasi 


an 


10. 


Western White orCaucaBian 





Item analyses were then conducted for each group of subjects so defined. 
The item analyses were performed using a procedure outlined by Angoff ^ 
Ford (1973) • In this procedure ^ the proportion of a sample or sub-sample 
answering a given item correctly (known as the ''g^^-value") is first calcu- 
lated* The p=values are then transformed to an interval scale by 
replacing them with their normal-curve equivalents (called normal deviates) , 
Because the normal deviates have a range from -1 to +1, these are often 
subjected to a further transformation so as to eliminate negative values. 
In the Angoff and Ford procedure^ the normal deviates are transformed to 
delta-values by the linear transformation, A = Uz -h 13. 

It should be noted that item difficulties computed by the above procedure 
ignore what are, at times, important factors. One factor ignored Is that 
related to the position of an item in a test. Items occurring near the end 
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of a test will have fewer correct responses merely because fewer examinees 
attampted them. The greater the iinportance of time in the test (i*e., the 
higher the "speededness" of the test) , the greater the importance of this 
item position factor* In the test battery used for the National Longitudl-- 
nal Study only the Mosaic Comparisons Test is highly speeded* For this 
reason, only the first 20 items of the second of three parts of the Mosaic 
Comparisons Test were used in the analysis. No item analysis procedural 
however, precludes the necessity of subjective Information with which to 
judge the validity of the statistical computations, Accbrdingly, item 
analyses reported in this study are accompanied by descriptive information 
concerning the itemy including its position in the test or subtest, the 
proportion of persons for each group answering the itemj and the itein itself ^ 
where test security limitations permit. 

Having computed the item deltas for each item and for each of the ten 
mutually exclusive groups given above, the next step in the procedure was 
to cross-plot the- deltas for nine of the groups in contrast to a tenth group 
(North Central miite or Caucasian), For each cross^plot, the group beinp 
examined was placed on the abscissa and the delta values for the North 
Central Wliite group on the ordinate. These cross-plots normally result in 
a narrow elliptical pattern with the major axis extending from the lower 
left CO the upper right, very much In the same way as seatter--plots of pre^ 
dictive single observations used in correlational analysis. One should note, 
however, that the points in the cross-^plots under discussion represent large 
numbers of observations (each point represents two delta values and each 
(leita value was determined from the total of all encounters with the Item 
by the group it represents). Thus it is not unusual to find that when a 
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correlational analysis is performed on points so derived, that the corre- 
lational values obtained are typically as high as .98 or .99. Where the 
two groups being Lompared are very different the correlations will not be 
quite so high. In the present analysis, the line of best fit used was the 
major axis of the elliptical patterns of points rather than the 
regression line usually involved in correlational analysis. 

An important feature of the major axis is that it indicates the general 
degree of difficulty of all items taken together for a given group. If all 
items j on the average, are of equal difficulty for both groups being con- 
trasted^ then the major axis will have a slope of 1.0 and an intercept 
(projected) of zero. If the items in general (that is^ the whole test) 
are more difficult for the group plotted on the abscissa, then the regres- 
sion line will have an intercept less than Eero, And if a test is easier 
for the group whose delta values are plotted on the abscissa, the intercept 
will be greater than zero* The slopes of these more and less difficult 
lines may be different from 1.0. 

Cross--culturally unstable items are those with the most aberrancy 
around the line of best fit for a particular group. Using the symbola x 
and y to represent the delta values for two groups being contrasted and 
using the slopes-intercept form of representation for a straight line, 
y ^ ax + b j 



iud b ^ M - aM_, With these relationships from Angoff & Ford (1973), 



a 




2r s s 
xy X y 



y 



X 



the major axis of the ellipse representing any contrast Is defined. The 
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symbols M and s above represent the mean and standard deviation, respectively 
r tlie correlation between the deltas for the two groups ^ and the subscripts 
K and y the abscissal and ordinal coordinates. The perpendicular distance, 
d., of each point, i, in the cross^plot to this major aKls is given as 

ax. ^ y. + b 

When d^ = 0 for a particular item, then the Item is perfectly stable with 
respect to the two groups being contrasted. When d^ > 0, the item tends 
to be more difficult for the group on the ordinate than were most other 
items of the same test for the same group* Such an item would be said to 
be positively unstable. If d^ < 0, then the item tends to be more diffi^ 
cult for the group on the abscissa than were most other items of the same 
test for the same group* 
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Classification Variables 

Classification variables were used to categorize participants as well 
as to indicate fundamental differences among groups being compared* These 
variables were obtained from NLS survey questionnaires as follows t 

Sex* Sex of participants was obtained from the NLS Student Quastion^ 
naire* Those survey students who did not respond to this item or did not 
return a Student Queitionnaire could notj of course, be classified with 
respect to sex* 

Ethnicity * The ethnicity of participants was obtained from item 84 
of the NLS Student Questionnaire (reproduced below)* All participants who 
omitted the item or did not return the Student Questionnaire or did not 
take the NLS test battery were excluded from the study. 

84* Hew do you deicribe yourself? 

(Circle one.) 

Amurican Indian 1 

Bhit'k c>r Afro-Amork^MiM»r Nugro 2 

MoKitan-AmuHcan or Ciiii-am) , \i 

Puerto Hitan ^ 4 

(Jthur Latin-Amuriean origin 5 

Oriental or Anian-Amurican B 

Whitu or Caucasian 7 

Oilwr. - .. .8 

Language Spoken in Home . The language spoken most often in the home 
(English or not English) was obtained from item 88 of the NLS Student 
Questionnaire as indicated below, 

as Is Enaliih the language ipoken most oft«n In your hom#? 

~ ^ (Circle oneO 



No 



I 



YoH = ^. 2 
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Time in Conmiunlty . Tima in community was obtained from item 89 of the 
NLS Student Questionnaire as indicated below. 

89. How long have you lived in the community in which you now live? 

(Circle ent.) 

All my life. . , 

Ten or more yoar^ . . , , . . 2 

Five to ten years. , = 3 

Three to four yonrs . , . = 4 

One to two yearH, , . . . .5 

hem than one year . . = , . . = = 6 



Parants' Educational Level * Father's education and mother's education 
was obtained from item 90 of tlie NLS Student Questionnaire ^ duplicated below,. 



90, What was the highest educational level each of the following persons completed? If you are no 
please give your best guei.s. 

(Circle sne number In each colt 

Oh 
bfoti 



Doo^n't apply 

Did not t'ompletu high JHecondaryi Hchool 
Finished high Hchool or equivalunt 
Adult education proRrani 
BuHineHH or trade school 

Some college ■ 
FinlHlied t'cjllegc jAjUf yuarMt 

Attended graciuate or profeHHional huIumjI ^for examfjle. law or 
medieal Heh^Kjli, but did not attain a graduate or profcsmonal 
decree .... 

Obtnine*! a /-raduate or profeHHitmal degree (f^jr example, M.A., 
Fh,l).. or M.D.J 



Father or 

male 
guardian 

. .1. . . 

. 2 

. .3 

. 4 

. 5. . 

. . . 7 . . . 



Mother or 
female 
guardian 



1 . 
2. 

3. 
4. 
5, 

7. 



9 9 
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Parants ' Income > Parants' income was obtained from item 93 of the NLS 
Student QuesCionnaire as indicated below. 

93. What is the approximate fncome before taies of your parents (or guardian)? Inelude taxable and non- 
taxable income from all sources. 

(Ctrele one.) 

LoH^ than $3, 000 a year inlKJul $H() a wt^k or lesHi 01 

Bftweun $3.UU0 and $5,!)9y a y«^nr ' frcmi $60 to 

Snnawei^k) . 02 

Betwivn $6.(KK} nnd $7,499 n year ifrom $120 to 

$149 a week J. .03 . 

Betwuen $7.f300 and $8,999 a year from $150 to 
- $179 a weckK 04 



Betwuon $9,000 and $10,499 a year tfrom SISO to 

$209 a wtH'k h 05 

Between $10,500 nnd $11,999 a yenr * froni $210 to 

$239 a weuk). . . 06 

Betw«H*n $12,000 and $13,499 a year ifrom $240 to 

$269 a week} 07 

Between $13,500 nnd $14,999 a year ifrom $270 to 

$299 a week). . . . 08 

Between $15.(K}0 and $18,000 a year from $300 to 

$359 a week} . 09 

Over $18,000 a year (about $3fi0 a week or more) . _ . 10 



Cormnunity Siza > School coimnuhity size was obtained from item 40 of the 
NLS School Questionnaire, This item, duplicated below, was completed by the 
NLS Survey Administrators in the schools particlpatlni in the NLS, 



40. Which of the following best describes the location of this school? 

(Circle one.) 

In a rural or farming rommunity . . * 1 

In M Hniall t-lty or town of fewer than fiO^OOO people 

that in not a Huburb of a larger f>laee. . 2 

In a medluni-mzed tuty (50,0(M) 100.000 peoplu) 3 

In a HUburb of a medium-Hized eity / = 4 

In a InrRo t^ky (100,000 500.000 |)eople) 5 

In a Huhiirb of a large eity, . . , . , G 

In M very larKo eity iovur/300,000 |K»opie). . 7 

In a Huburb of a vgry large eity , : . =8 
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Geographic Classifications , The four geographic divisions of the 
United States^ as defined by WESTAT Corporation, were used. The states 
included in each division were as follows t 

(1) Northeast (Maine, New Hampshire, Vermont, Massachusetts ^ Rhode 
Island, Connecticut j New Yorkj New Jersey, and Pennsylvania)* 

(2) North Central (Ohio, Indiana, Illinois, Michigan, Wisconsin^ 
Minnesota, Iowa, Missouri, North Dakota, South Dakota , Nebraska, 
and Kansas) , 

(3) South (Delawares Maryland, District of Columbia^ Virginia, West 
Virginia, North Carolina, South Carolina, Georgia, Florida, 
Kentucky^ Tennessee, Alabama ^ Mississippi, Arkansas ^ Louisiana^ 
Oklahoma, and Texas). 

(4) West (Montana, Idaho, Wyoming, Colorado, New Mexico, Arizona, 
rr-^. Utah , Nevada i Washington , Oregon , -California s Alaska, and Hawaii) 
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Sample-Description by Groups 

The original sampla of 17,726 cases was reduced to 1^5828 casas by 
the requirament chat each case to be analysed have both an NLS Student 
QuGSClonnaire and an NLS Student Test Hook answer sheet* The distri- 
bution of these cases by socio-cultural group, sex, and primary 
language spoken in the noma (English or other) is given in Table 3. 
For a few of the cases there was no response to the sex and language 
spoken questions and for this reason the figures do not add to Che 
totals in Table 3. Within the groups, the distribution of males and 
females appears to be relatively uniform. Major differences occur, 
however, with regard to language spoken in the home* More Puerto Ricans 
(39) said that English was not the primary language spoken in the home 
than said that it was (38). A very large proportion of Other Latins 
(48) reported that English was not the primary language spoken in the 
home as CQmpared to those who said tliat it was (56)* The same was the 
case for Maxican-i^ericans (214 not English vs* 262 English). For 
the other groups, only small proportions said that English was not 
the primary language spoken in the home. 

Table 4 shows summary data (means and standard deviations) for 
socioeconomic variables * degree of urbanization, and time in community 
for all groups and the total. The White Western group reported the . 
highest mean father's education and the Mexican^^erican group the 
lowest. The same contrast occurred with respect to mother ^s education 
with White Western highest and Mexican-'^erican lowest. For parents' 
inrnm^. hnwpvpr. Puerto Ricans were lowest. School community size 
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Table 3 

Distribution of Cases by Socio^Cultural Group 



Gro ups 


tteles 




Home Language 
Not Primarily 
English English 


Total 


American Inaian 


Q 1 




24 


151 


178 


A fro^ American 


826 


1,051 


157 


1,720 


1 ,895 


Mexican^ American 


251 


235 


214 


263 


491 


Puerto Rlcan 


39 


40 


39 


38 


79 


Other Latin 


. 49 


56 


48 


56 


107 


Oriental 


93 


82 


52 


122 


176 


\^lte NortheasCern 


1,278 


1,499 


189 


2,603 


2,798 


White North Central 


1,848 


1. 


224 


3,356 


3,589 


White Southern 


1,793 


\,740 


230 


3,319 


3,557 


White Western 




y2i 


111 


1,843 


1,958 


Total 


7 291 


■',426 


1,288 


13,471 


14,828 
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Table 4 

Suniinary Data on Socio-Economic Variables, 
Degree af UrbaniEacton * and Time in Community 



Group Father's Mother's Parents' School Com^ Time in 

Education Education Income munity Size Community 



Means 



Amtirican Indian 




2.94 


4,92 


3.24 


2.27 




7 R7 


3 * 18 


3.17 


4.26 


2.44 


Mexican^ American 




2.45 


3. 57 


3.57 


1.94 


Puerto Rlcan 


2. 58 


2.56 


2.85 


6.41 


2.79 


Other Latin American 




3*50 


4.45 


5.23 


2.94 


Oriental 




3.80 


5,89 


4.0O 


2.49 


White Northeastern 


A 10 


3.71 


6.15 


3.86 


1 . 95 


WnlCe Nortn uentrai 


1 Q8 
J • ?y 


3.72 


5.94 


3.41 


1 . 96 


Wliite Southern 


4 Ofi 


3,68 


5.69 


3.39 


2.26 


Wnice western 


4. 61 


4.10 


6.40 


3.90 


2.39 


Total 


3.94 






J - / u 


2.17 






Standard 


Deviations 








1.85 


1,56 


2.90 


2.29 


1.36 


Black 


1.68 


1.73 


2.37 


2.32 


1.53 


Mexlcan-^erlcan 


1.55 


1.28 


2.47 


2.36 


1.28 


Puerto Rlcan 


1.39 


1.42=. 


1.61 


1.51 


1.56 


Other Latin American 


2.30 


1.85 


2.75 


2.27 


1.58 


Oriental 


2.26 


1,99 


2.90 


2.33 


1.39 


White Northeastern 


2.22 


1,88 


2.73 


2.24 


1.26 


White North Central 


2.21 


1.82 


2.70 


2.46 


1.28 


White Southern 


2,33 


1.91 


2.89 


2.33 


1.44 


White Weatem 


2.32 


■ 1.95 


2.72 


2.39 


1.37 


Totnl 


2.25 


1.88 


2.91 


2.38 


1.39 


%ote that this s 


cale is 


reversed^=a low 


value indlcf 


ites a long 


time 


in the cOTmnunity 


(see pa 


ge 23) 
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While these groups differ considerably on variables such as SES 
which are well known to be related Co test performanGes no adjust- 
mencs are made for these differences in the present study* Since 
each of the socio^cultural groups were selected by a carefully con- 
ducted random samplings these group differences are considered to be 
representative of cultural differences. From this point of viewj no 
adjustments are appropriate. 
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Results 

Cross'-plots of all item deltas for each socio-cultural group, In 
contrast to the White North Central group, are shovm in Figures 1 through 
9, A dotted line has been drawn in each figure at 45 degrees to serve 
as a raference. Items falling on or near this line Vre of approximately 
equal difficulty for the White North Central group and the group to 
which it is being- compared. The solid line passing through the center 
of the cluster of item points C+'s) is the major axis of the ellipse 
represented by these points. If the solid line falls below the dotted 
line It Indicates that the battery as a whole was more difficult for the 
group whose del ta-'Values are plotted on the abcissa- In Figure IV for 
example, the position of the solid line relative to the dotted line indl-^ 
cates that \ the battery was more difficult for American Indians than for 
the White North Central group . Conversely, Figures 6 and 7 suggest that 
the battery was slightly easier for Orlental-Americans and for the 1^1 te 

Northeastern group. 

The results of primary Interest, however, are not those related to 
the comparative difficulty of the battery as a whole. Rather , the focus 
of the present study Is on specific items—especially those where the 
distance between the item-point (+* s) and the solid line is substantial. 
A number of such points may be noted from Figures 1 through 9. To provld 
a more convenient means for identifying specific Items and for comparing 
them across groups, tables of values of di were prepared (Table 5 through 
10) / In these computer^generated ,ta^^ d^'s nre termed D-Values, 

The six tables correspond, respectively , to the fix tests of l^ational 



41 



■■ -31- . .. 
Figure 1 

Cross-plot of Daltas for American Indian 
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Figure 4 

Cross-plot of Deltas for Maxlcafi'-Ainerican 




□ELTflS FOR MEXICRN-flMERICflN 



45 



ERIC 



Figure 6 

Cross^plot of Deltas for Oriental 
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Figure 7 ' - 

Cross=plot of Deltas for White-Northeastern 
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Figure 8 

Cross-plot of Deltas for i^ite-Southaastern 
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Figure 9 

Cross«plot of Deltas for Whlte=^Western. 
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1- 3 -0.1^ 0.56 0.0? OJO 0.24-0.36 0.17 0.2^ 0.04 0.16 0.31 

I-n -J-i^ C.7U 0.07 0.70 -0.41 -0.04 0,35 0.16 0.17 O.b 0,38 M 

Ml w.C^ i.ii 042 1.43 0,45 0.2J 0.40 0.2S 0,26.. 0. . ^ 

Ml -0.06 1,06 0.27 1.52 0,53 -0.34 0.39 0.26 0,28 . . 

hU -C.27 G.93 0.1d**w 0.5E -0,33 0,4r 0.28 0. 13 0.2b 0,40 

l-lh -Q.2r***** 0.19 ***** 0.72 -0.5i 0,44 0,25 0,16 0,14 0.3-) 

.Qlil ,j,05 ***** ***** -0.54 0.42 0.21 -0,03 0.00 0,30 - 

j,^^ ,*H^ ******************** -0,72 0.46 0.16 0.05 -0.010.43 

w** *************** -0.70 ********** **** -0.7C 0.0 : 

j.^^ mn ***** ***** ***** ***** ****^ s**** ***** mr o,C 0,0 

i^i^ ;n*** ***** ***** ***** ;*** 0,0 

j^^^ ^i^^i ^^^11 ***** ***** ****^ *«$*i **i^E* nm 0,0 0.0 

^L^r -0.17 0.46 0.01 0,50 0.13 -O.U 0,30 3.15 0.07 

S,g. C.iSy 0.490 0,260 0.637 0.434 0.471 0.149 0.136 0.153 

1*^** O-VALUES NOT COHPUTED fCH HISSING^I^ 
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Longitudinal Study battery used for the study. Each table contains an 
item identification number as the extreme left-hand colv.Tmp and group 
identifications at the top of the next nine columns. The group Identi- 
fications used are as follows. American Indian (AI) , Af ro--Amarican (AA) ^ 
Mexican- American C^^A) » Puerto Rican (PR) , Other Latln-^American (OL) j 
Oriental (OR), White Northeastern (WE), White Southern (WS), and White 
Western (TO), Note that the White North Central Group (WC) is not shown 
in these tables since it is the group to which all other groups are being 
compared* Marginal means and standard deviations are also given in each 
table. The group means and standard deviations * at bottom, are useful 
in judging the relative ease or difficulty of an entire subtest for any 
given group. The item means and standard deviations ^ at right, provide 
information of a summary nature on each item* D^Valuea were not computed 
if the proportion answering correctly was less than * 05 or greater than 
•95, or if less than 50% of the sample responded^ to the Item, 

Vocabulary . Table 5 presents the values of d^ for each group on each 
item of the NLS Vocabulary subtest t Negative values of d^ indicate that a 
particular item was easier for a group relative to other items in the NLS 
battery and positive values indicate that the item was more difficult for 
that group than were other ilams in the NLS battery for the same group* 
Table 5 would indicate that Vocabulary items 2, 4, 13 ^ and 14 were rela- 
tively easier for Other Latin-Americans* Moreover , this relative ease 
extends to both Mexi can-Americans and Puerto Ricans for; items 13 and 14. 
To a slight degree^ the same could be said for item 2^ but with much less 
confidence* Item 4^ however, would appear to be relatively easier only for 
Other Latin-Americans and Puerto Ricans* A different/ piGture emerges from 
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Items 13 and 14 of the Vocabulary test. Like Itetns 2 and 4, they appear 
to be relatively easy for Spanish^speaking groups. But American- Indians 
and Afro-Americans also show large negative values for items 13 and 14, 
ThiH outcome probably relates to the fact that items 13 and 14 have the 
lowest P-Values (propcfrtion of sample answering correctly) of all the 
items in the Vocabulary test. ThuSj items which are very difficult: for 
the majority groups, may be relatively easier for minority groups than 
other items in the battery. Whereas the minorities as a whole find items 
13 and 14 relatively easy, however , some Spanish-speaking groups find 
these items and others absolutely easier. A greater proportion of Other 
Latin-Americans answered item 2 correctly than did the White Centr^i*.! 
group (.56 to .50)/ The same was true for item 13 (,36 to ,32) and for , i 
item 14 (.35 to *30). These P-Values are given for all items and all 

groups in Appendix D, 

. Picture-Number . Tn observing the results for the Picture^Numbi^r 
test, it should be noted that the test Is in two parts of 15 items each* 
Flftt^en picture-number combinations are first presented on a single page- 
The examinees are instructed to turn to the next page and not to look 
back. After turning the page, they are confronted with the same 15 pic- 
tures as on the previouB page, but without the two-digit numbers with = 
which the pictures were originally paired. Moreover, the pictures are 
now in a different order. Thus, when one observes in Table 6 for item 3 
of the Picture-^Number test large negative D'-Values for minority groups, 
it Ih tmportanc to know that item 3 was presented second originally in the 
picture and number pairings* it is also important that the picture was 
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of something extremely common and easily identified (a dog). A similar 
case made be made for items 18 and 19, the 3rd and 5th items of the second 
part of the Picture-Number test. Item 18 (a l.ousej had been presented 
on the first page as the first picture^number pair and item 20 (a harmner) 
as Che fifth, \shat is of perhaps of even mcra interest with respect to 
the Picture^Number test is that the test as a whole is relatively easier 
for minority groups than ire other tests in the battery used. This is 
suggested by the mean D-Values shown at the bottom in Tatle 6* Note, 
however, that Orientals do not fit the pattern cf the o^her minority 
groups. In summary, the Picture-Number test app^"s easier for most mln^ 
ority groups than other kinds of tests , as are Items within it which are 
presented early In a sequence of pictures-number pairs and which contain 
pictures of common and easily identified objects/ 

Reading , In Table 7 one observes an interesting pattern of D-Values 
for Afro-Amer leans on the first five items. These Devalues are all neg-- 
ative nnd most are relatively large, suggesting that Blacks found the first 
five i tenia of the Reading test relatively less difficult than the other 
items of the battery. This result Is especially interesting in view of 
the fact that these first five items all relate to a passage about Black 
television. Another interesting pattern occurs for item 15 where minori^ 
ties tend toward relatively large and negative D-Values, However, a look 
at the P^Values (Appendix D) for this item shows it to be extremely diffi- 
cult for all groups. ^ The overall average proportion answering correctly 
was only 20%--^a proportion that could have been attained by guessing alone* 
For no single group did more than 30% answer th'ls item correctly. Thus, 
the relative ease of item 15 for minority groups refl-rcts only a depression 
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in the ease of the item for the other groups. Considering the entire 
reading test, especially in terms of the group means at the bottom of 
Table 7, It does not apyear that the test is extremely disadvantageous 
for any group or set of groups* 

Letter-Groups . The table of Devalues for the Letter-Groups, 
Table 8, is remarkably free of notable patterns. This would suggest 
thitt icems of this type are relatively homogeneous across cultures. 
There is some suggest1r-n, however, t'N^t this type of test may be trouble- 
some for the Spanish^speaking groups. The group means at the bottom 
of Table 8 for Mexican-Americans, Puerto Rlcans, and Other Latin-Ameri^ 
cans are somewhat nigher than the means for the other groups. And for 
the Puerto Ricans, in particular, the length of the test appears to 
have axacerbaced this condition, as one notes an increase In D-Values 
£3 ahu end of the test is approached. 

Mathematics , In Table 9, items 2 and 5 provide a useful contrast 
of an itrm relatively easy for minority groups (item 2) and an item 
relatively difficult for minorlEy groups (item 5). Since both of these 
items are near the beginning of the test, the speed factor plays a minor 
role. In item 2, the *'Value of 11 dimes" is to be compared with the 
quantity, "Sl.ll**' The cask is to determine which quantity is greater, 
if uhey are equal, or if the size relationship cannot be determined 
from the Lnformation gl-en , For both the Wliite Central group and the 
Other Latin-American group, the proportLon answering this item correctly 
was 76%* In contrast to icem 2, however, item 5 would appear to be 
extraordinarily difficult for minority groups relative to the other items 
in the entire battery* The large D-Value (1,36) for American -Indians 
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is especially intriguing. Item 5 of the Mathematics test posed a 
contrast between the quantity, '"i^, " and the quantity, "9." While 85% 
of the Oriental group answered this item correctly, only 42% of the 
ATnerican--Indian group did. Given the simplicity of this particular 
item, what is suggested is that American- Indians in the United States, 
as well as other minority groups, receive seriously deficient training 
in the fundamentals of mathematics. Item 2, which was relatively easy 
for the minority groups * requires a kind of knowledge easily obtained 
in evei^ay non^school life. 

Mosaic Comparisons * Since only a middle group of twenty items 
from the NLS Mosaic Comparisons test were analyzed (the first twenty 
items of the second of three parts of the test), it Is not appropriate 
to discuss these twenty items as rapresentlng the NLS battery. The 
results do suggest ^ however, that this kind of test Item is relatively 
stable across cultures (Table 10). Table 10 suggests as well that the 
primary source of instability is the speededness of the test. Blacks 
and Puerto Ricans were most affected by this speed factor (note .the 
increasingly large positive Devalues with item number and the low 
response rates for the later items as indicated by the asterisks). It 
is probable that the instabilities which do occur are not due to the 
item type, but to the fact that speeded tests are relatively more diffl 
cult for these groups than non-speeded tests. 
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Discussion 

A number of interesting issues emerge from the results of this 
study. IJhile the cross-cultural instabilities of some item types suggest 
problems in test construction, instabilities in other item types point 
to inadequacies in schooling. It is thus not entirely clear from the 
numerical analyses performed what action should be taken. Vocabulary 
items, preserited in English ^ which are easier for Spanish-speaking per- 
sons than they are for English-speaking persons represent one example 
where the problem is most probably one of test construction . On the 
other hand, mathematics items which appear extraordinarily difficult for 
minority groups—despite an apparent sirapllcity—indicate that the school- 
ing of most minority groups may be sarlously deficient in mathematics. 
But the exclusion of such items from tests would preclude the detection 
of similar schooling problems in the future. 

Nor would it seem entirely appropriate to exclude a set of items 
about Black television because these items were relatively easier for 
31a.:Us. Perhaps all tests need to have more such items and, additionally, 
icems associated with other cultures as well. The decision to exclude 
or include specif ic items in a test is, therefore, a decision far removed 
from any purely statistical procedure. Not only do matters of content 
and predictive validity need to be considered, but also matters of subtXe 
cross-cultural differences and the socio-poLitical context that accomp- 
anies them. Neverthelessi statistical indices are especially useful when 
combined with other Informat ion , They were especially helpful in the 
present study in Isolating small groups of items for further study. 



The instabilities in the NLS Vocabulary subtest have some especially = 
interesting potentialicles with respect to the groups speaking Spanish. as 
;a native language. Although a thorough analysis of this possible socio- 
linguistic phenomenon is beyond the scope of this study, some, interesting 

directions for research can be pointed out, 

- Items 2, 4, 13^ and 14 of the Vocabulary test are of special interest* 
These' are items that appeared to be relatively easier for at least some of 
the Spanish-speaking groups than were other items in the NLS battery* Item 
2 asked for the synon>nn for the English verb j "convalesce. " The correct 
"responili^wa^^tfii~En^ 

particular kind of item is that these same iverbs have cognates in Spanish^- 
"convalecer" and ■'recuperar/' respectively. It is thus not surprising that 
Spiinlsh-speakers did better on the item than on other items in the NLS bat- 
tery. What is surprising is that one Spanish-speaking group, Other Latin^ 
Americans, appears to have done better with item 2 than either the White ^ 
North Central group ^ the White Southern group. Of the 60 Other Latin--' 
toerlcans who attempted the item, 61 percent gave correct responses. This 
compares to 54 percent and 55 percent, respectively, for the White North 
Central group arid the White Southern group , ^ (See Appendix D for proportions 
of groups responding to specific items correct ly) t 

Item 13 of the Vocabulary test is similar, since it also involves a 
double cognate (both the stem and the correct option are Spanish cognates) * 
The stem of item 13 was the English adjective ^ "impetuous ,|V and^^^^t correct 
option was the English adjective, "impulsive J*- -The^ c cognates 
*in Spanish are "impetuoso" and ''impulsivo . Items 4 and 14 inyqlye cognates 
also but these' are not double ones , since only the stem in each case Is a 



cognate. Apparently, howeveri this small advantage helps the Spanish^ 
speaker. , The stem in item 4 was "novicej" which has the cognate, 
"noviclo." _ And the stem in item 14 was ■'enigma," having the identical 
cognate in Spanish* 

P Since not only Spanish--spaaking minorities but other minorities 
found some of these same vocabulary items relatively easier, the crose^ , 
cultural instabilities noted are not entirely attributable to language ; 
factors. In items 13 and 14, in particular , it is" clear that these 
-vocaburary^ wordr'^-^ere^ ffspec 

group used for comparison in computing the Index, Thus what might 
appear to be an advantage for minorities is, in fact, due to a disad- 
vantage for the majority groups. That is , even. though majority groups 
are usually at an advantage when dealing with reasonably difficult vocab= 
ulary items, chat advantage is destroyed when the vocabulary words become 
extremenly difficult. To conclude, however, that vocabulary tests should 
contain only extremely difficult words so as to improve the relative 
performance of minority groups is certainly erroneous. It is perhaps _ 
safer "to suggest that vocabulary tests may be especially difficult to 
construct such that they are stable across cultural groups . ' 
If one takes the view that tests should reveal .cultural differ- 



ences as lit ties as possibie,tben tests such al"^Plcture-Number, nettef-^^^^ 
Groups, and Mosaic Comparisons would appear appealing from the results 
of this study. But it is also true that such tests reveal little about 
educacional differences, Reading and mathematics test items of the types 
studied here J conversely, indicate important cultural and educational 
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differences having clear implications for policy actions. If certain 
groups of the population cannot perform sitnply taught arithmetical 
operations, then it Is important to know that such is the case so that 
educational programs can be designed and 'implemented to correct such 
problems. And If reading is taught best where the reading material 
has cultural relevancej then this would seem to have important Implica- 
tioris for educational practice as well, _ 
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Cpncluslons 

This study demonstrates that useful indices of the cross'-cuitural 
stability of test items (as well as tests) can be crea Perhaps further 

efforts will yield better indices than that used herein. The study also . 
shows Chat no purely mechanical or statistical procedura is sufficient for - 
making decisions about the inclusion or exclusion of items from a particu=' 
lar test. An instability across socio-cultural groups may reflect a cul-- 
tural tradition that deserves recognition. In such cases , items which 
serve to_^ display cultural differences play a positive role. But in other 
instances s where an instability suggests that the outcomes are due to some 
unintended and undesired consequence , these instabilities serve no useful 
purpose and should be eliminated if possiblei A case in point is where 
Spanish^speaking persons perform better on English vocabulary items because 
the words involved may be cognates more common in Spanish than they are in 
English*". 

A perhaps more important aspect of the study ^ however ^ is that it 
suggests an approach to the present controversy over test bias that might 
be more palatable to minority groups than current approaches , Rather than 
emphasizing predictive analyses base,d on external criteria (which themselves 
niay be biased) , analyses of individual- test - items -dn-the-contexts of--th 
-use r-socio-^cul tural differences and. o t h e r_s ub j.e c_t ive_.cjjjjpxi.a mi gh t _1 ea_d ^ 
to some reconciliacion of issues . After having created tests having optimal 
cross-cultural stabilities , witHout the use of ex terEfal criteria j the next ^ 
tci&k would be to Qbserve the predictive consequences of such procedures* 
If this new approach yielded predictive validities not significantly below 
those commonly obtained in less cross-culturally stable tests, then it would 
tend to satisfy psychometricians as w members of minority groups. ' 
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Appendices 



The appendices following this page are: 



Appendix 


A/ 


Sample Test Items and Answer Sheet 


Appendix 


B. 


Survey Administrators Guide 


Appendix 


C. 


Test Analysis^ 


Appendix 


D. 


Item P-Values (proportions of .samples 
responding correctly) 


Appendix 


E. 


Item Delta-Values (transformed Values) 



Symbols used In Appendices D through 

A I - American Indian 
AA - Black or Afro-American or Negro 
MA - Mexican'^American ■ 
PR - Puerto Rican 
OL > Other Latin-American origin 
OR > Oriental or Asian-American ^^^^.l^^J * 
WE ^ \^ite or naucaslan, Northeastern United. States 
WC—- Wliite or Caucasian^ North Central United States 
- White or Caucasian, Southern United States 
- - - -W^-^^^^^ Uhited-^States^"r_.__. _ _ 

N - Number of cases v - ' 

NR - No response 
P - Propnrtlon of sample or subsample responding 
correctly 

- MS "^^^ --^^ --^ 

MT - Mean Total Test score . ' 

D - Distance, in delta unlts^ from the major axis of th 
: V elliptical pattern of points resulting from the cro 
: plot of Item: delta-values for a group in contrast t 
a Htandard comparison group. 



APPENDIX A 
Sample Test Items 
and 

Answer Sh«Met 
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GENERAL DIRECTIONS 



This. test has six sactions. Some sectioni have more than one pare* During the time 
allowed for each section or part, you are to work only on it* The time limit for each 
section or separately timed part is printed at the beginning of each section or part, 
and the supervisor will tell yoii when to begin and when to stop. If you finish a section 
or part before time is called, go back and check your work on that section or pan 
only, . ■ ' ■ - - ■ 

Your score on each section will be the number of correct answers minus a percentage 
of the number of incorrect answers. Therefore^ it will n^ be to your advantage to 
guess unless you are able to eliniinate one or more of the answer choicesrr 

Mark all of your answers on the separate answer sheet, as.no credit will be given for . 
anything written in the test book. Make your marks on the answer sheet heavy and black, 
as in the examples below. 



Sample Answers 



ABC 



Bq sure that the entire box is blackened. 

If you wish to change an answer, erase your first mark completely. 

CONTENTS OF TEST BOOK 





Section l; 


Vocabulary 


5 minutes 




Section 2 


IHcture-Number 

(Two parts of 5 minutes each) 


10 minutes 




Section 3 


Reading 


15 minutes 




Section 4 


Letter Groups 


15 minutes 




Scctiun 5 


Mathematics 


15 minutes 




Section 6. 


' Mosaic ctomparisons 
(,irhr,cc parts of 3 minuteH cach) 


9 minutes 



69 minutes 



7^*3 10 1 
i'22i'24 



erJc 



SI 



yOCABULARY 
Timb--5 minutes 



1 



Directions: Each of the questions below congigts of one wgrd followed by five words or phrases. You are to select the 
one word or phrase whose meaning is closest to ihut of the word in capital letters. 

, ■ Sample Question - ; \ . Sample Answer ; , 



CHILLY : A A 18 



( A) lazy 
( B) nice 

(C) dry 

(D) cold 

( E) sunny 



'in order to find the correct answer yog- look at the word chilly and then look for a word below it that has the same or 
almost the saine meaning When you do this, you see that cold is the answer because cold is closest in meaning to the 
word chilly. i 



Ls section of the test contained 
15 Items sitnllar to the sample above , ) 



STOP 



ERIC 



rP YOU FINLSH DETORE TIME IS CALLED, CHECK YOUR WORK ON THIS SECTION ONLY. 
DO NOT WORK ON ANY OTHER SECTION IN THE BOOK. - 



SECTION 2 
PlCrmRE-NUMBER 



2 



D irections: This is a tesi of voir ability to remember picture- number combinations. The section has two pafts. In 
mch pare you will study a page of fifteen pictures with numbers. On a study page the picture-number pairs will look 
like this: 






After studying the page showing both pictures and numbers, y^ will be told to turn to a page showing the pictures m 
i dlffsren: order, 

Evpnioles: 



1, 






tin your answer sheet there are ten boxes with nunibers above them for each question. One of the numbers will be the 
number that goes wUh the piciuru/ Ynu arc H) hluckc 



ENamplcH; 1 , 



2 24 ;U 44 5 



57 65 71 77 92 



15 '27 J4 41 46 

^- □ □ m a □ 

13 ly 28 :n 46 

3. 



35 62 75 82 89 

an □ □ 



58 62 67 73 ' 97 



umber that goes with the oiccuiu of j lelephune i?^ 73, so for example I you would blacK^m Che box with 73 above it 
'V- csample 2 yoi! would blacken the box with 34 above it, l-or example 3 you would blacken box wtrh 46 above it. 
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IDCV NOr TUKN THIS I'ACn? UNTIL . YCXJ AlUi TOLD TO DO SO. 



3 



SIU^TION 3 
: KUADING 
l imu-^ 15 minutes 



Dir ections: Each paNsagc fnllowed bv qucHiiuns hA^ud nn hh comcm. After reading n pasnagc, dmo^C the best 
annucr tu unch qucsunn jiuj blacken the currcKpimdmg .pacw un [he answar ahuei. Answer all quosnnnH fnllowmg a 
passage tm the basin of what \^ stated ur niiplieU in thai passage. 



SAMPLE ITEM I 



IL 



Of all the forces reshaping the American city, the 
most pawerful and msistent are those rooted in changing 
methuds at transportation, /fhe changes are Sii big and 
ulnifius that it is easy to forget how* reniarkable they are. 
The streetcar has ail but disappeared* the bus is proving 
an inadequate substitute, coniinuter rail service worsens, 
s'lbways get dirtier, and new expressways pour more 
and more automobiles into the center of town* 

If transit riding continues to decline and if automo- 
bile use continues to rise uncliecked, how can the vital 
core of the city survive? iMany city planners say flatly 
that it cannot* The only sure way to relieve congestion 
and preserve the unifying core of the city, supporters 
uf mass -transit claim, is to get people out of private 
automobiles and into public transit — "to move people 
nor vehicles/' 

10. The author suggests that the remarkable changes 
in transportation are often overlooked for which 
of the following reasons? 

(A) They have taken place very gradually; over the 

years, 

(B) They have proved to be more effective than old " 

methods. 

(C) They are so obvious that they are taken for 

granted. 

(D) They have created new problems for city 

planners. 

(E) They have decreased cdngestion in the cities. 



12. 



13. 



The author mentions all of the following as methods 
of transportation which have become less popular 
with commuters EXCEPT 

(A) the bus (B) the automobile 

(C) the streetcar (D) subways (E) railroads 

The passage is primarily concerned with which of 
the following? 

<A) Various factors influencing the American city 

(B) The disappearance of the streeccar 

(C) The need for faster automobiles 

(I)) The growing network of expressways 

(E) The effects of [ransportation changes on the city 

According to the passage, many city planners feel 
that growing use of auComobiles rather than pufrlic 
transit will result in 

(A) the construction of more and more expressways 

(B) the deterioration of the vital center of the city 

(C) the relief of cbiigestipn in-rt 4"ity 

(D) a decrease in commuter rail:.^rvice 

(E) demands for lunicaiions on the.,.use of autO'^ ^ ^^'^^^ 
- mobiles^ 



CO ON TO THE NEXT PAGE. 



(This sectloh of the test contained 
5 reading passegas with accompanying 
questions similar to the Iteta above,) 
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SECTION 4 
LETTER GROUPS 



Dire ctions: Each question in thts section consists of five groups of lenere with 
four letters in each group. Four of the groups have a characteristic in common 
which the fifth group does not have. Decide which group is differed, and_black|n 
the spa^ on the answer sheet that corresponds to the position (A, C, U, or e.) 
of your choice. 



Note- The common characteristic will ^ be based on the sounds of groups of letters, 
th^apes of letters, or whether letter combinations form words or pares of words. 



Sample Quesnor s 



A 


B 


C 


: D 


E 


I 


I. NOPQ 


DEFL 


ABCD 


HIJK 


uvwx 




2. NLIK 


PLIK 


QLIK 


THIK 


VLIK ; 


^ 2 



Sample Answers 

IEEE 



in sample question 1. the letters in four of the groups are in consecutive alpha=^ 
betical order but group DEFL in column B is not; so space B has been marked 
in the si^mple answers, in sample question 2, four of the groups contam the _ 
letter L. letter group THIK in column D is the group that is different; so space U 
has been marked in the sample answers. / 



You will have 15 minutes to work on this section. 



DO NOT ITIRN THIS PAGE UNTIL VOU ARE TOLD TO DO SO, 



(This section of the test contained 
25 questions similar to the samples 
above,) 



Time^ 15 minucus 

Directions: Blacken rhe space on the answer sheet chat corresponds to the column which contains the letter group that 
is different. 

Note: The common characteristic^wili not bo based on the sounds of groups of letters, the shapes of letters, or whethe 
letter coinbinatlons form words or parts of words. 





A 


B 


C 


L) 


E 


1, 


Qppq 


HC HY\ 


^^^^^^ i 
i 1 1 U 


DDDE 


ML MM 


2, 


NABQ 


PEra 


[3 1 1 \ / 
KIJ V 


SJS/I Is 


CUWH 


3/ 


BCDE 


rUHi 


I if 1 \^ 

j Is 1 ^ fVl 


PR ST 


VWXY 


4. 


BDBB 


us G r\Q 
Mr Ud 




RRIR 


BBLD 


5, 


BDCU 


FHCI 


1 i k' M 

J l^N IVI 




TVWU 


6. 


LNLV 


Ui r U 




HRl t 


LLWS 


7, 


PABQ 


SEFT 


\/n\i/ 
V IJ w 


wWI 4^ 


FU2G 


8. 


CAEZ 


CEIZ 




CCA 17 


CAUZ 


9. 


BDEF 


FHIJ 


nj Is U 


I N r ' ^ r% 


SVWX 


10. 


DCDD 


HCHH 


M IVlLt fVl 




WWVW 


IL 


BCCB 


GFFG 


I M Ml 

L=,IV1IVIL=, 


f )R RH 


WXXW 


12. 


BVZC 


r y £Aj 


J V /lifs 


r VT f*v^ 


SVZT 


13. 


ABCX 






OPQX 


' uvwz 


14. 


ABDC 


E,Lir H 


III K 


OPRQ 


UVXW 


15. 


AAPP 








DDSS. 


16, 


GFFG 






RQQR 


MLLM 


17. 


ABCE 




IJ IN iVl 


wrV^ 1 




18. 


XDBK 


TNLL 


VEGV 


PrCO 




1 o 






NOQP 


PQSR 


TURS 


20. 


FEDC 


MKji 


DCBA 


HGFE 


JIHG 


21. 


CERT 


:KMTV 


FliXZ 


BODQ 


HJPR 


22. 


BEPW 


HJTX 


KNRZ 


KOSV 


WRPM 


23. 


PXCC 


EEQX 


RXGG 


USX 


TXLL 


24. 


AFBG 


EJFK 


GKHM 


PSQT 


RWSX 


25. 


Aour 


CTZR 


JHTN 


PBRL 


RTVH 




A 


B •- 


C 

: STOP 


D 


■■. E 
*, 



Fi. lSH BEFORE TIME IS CALLED. CHECK YOUR WORK ON 7TIIS SECTION ONLY. 
DO NOT WORK ON ANY OTHER SECTION IN THE BOOK. 



SECTION 5 
MATHEMATICS 

Di rections: Each problem in this section consists of two quantities, one plac^ in Column A 
and one in Column B. You are to compare the two quantities and on t.. j answer sheet blacken 
space 

A if the quantity in Column A is greater; 
B if the quantity in Column B is greater; 
C if the two quantities are equal; 

D if the size relationship canno; be decermined from the information given. 

Sample Questions Sample Answers 

Column A Column B 

4nrs I in ^ S [F 

Example 1. 20 per cent of 10 10 per cent of 20 l_i teii i_i 

Example 2. 6X6 12^12 2- HSSEl ; 



Answer C is marked in Example 1 since the quantity in Column A is equal to the quantity in 
Column B, Answer A is marked for Example 2 since the quantity in Column A is greater than 
the quantity in Column B. 

You will have 15 minutes to work on this section. , 



DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO DO SO. 



(This section of the test contained 
25 prdblems following the format 
described .above, ) 



5 



/rime— 15 minuies 

A The quancity In Column A U greater. 

B The quantity in C'olumn II is greaier, 

C The two quantities are equaL 

D rhe size relationship cannot be UetermineU from the inforniaticm given. 





Column A 


Column n 




927,343 
-9,9^9 


927,343 
-99,999 


2. 


Value of 11 dimes 


' Si, 11 


3, 


Length represented by 

3 Inches on a scale of 

4 feet to an inch 


A length of 12 faei 


4. 


46 4^ 6 


47-6 


5, 




9 


6, 


Degree rise in tem- 
perature from^6^ F 
to 4-5* F .n" 


Degree rise in tem- 
perature from -^S"" 1-'' 
to+6*F 


7. 


The product of an even 
number and an odd 
number 


The produci of two odd 
numbers 


8. 


6 

5 


120% 


9. 


Average (arithmetic 
mean) of 30, 32, and 
34 


Average (arithmetic 
mean) of 31, 32, and 
33 


10, 


2(-4) 




11, 


Cost per appie at a 
race of $0,40 per 
dozen apples 


Cose per apple at a 
rate of 3 apples for 
$0,10 


12. 


- 245 


2(10)3 +4(10)2 4-5(10) 


13/ 


• 4 X 3 X 2 X 1 
t . 2 X 1 


5x4x3x2x1 
3x2 XI 



tlulumn A 



Column 11 



Q u e 5 1 i ons 1 4^1 5 refer to the following graph. 

POPULATION OF THE UNITED STATES 

MillioQi 
180 




1910 1920 1930 1940 1980 1960 



14. Increase in population, 
in millions, 1920-1930 

15, Ratio 1960 population 
in millions to 1910 
population in millions 



Increase in populationj 
in millions, 1930-1940 



16, 



I 1 

2^ 3 



1 i 

2 ' 3 



17, 42(23) + 42(21) 



42(23 + 21) 
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GO ON TO THE NEXT PAGE. 



SECTION 6 
MOSAIC COMPARISONS 

Direcnons: This tost consists of pairs of mosaics, that is. V^^^^^^^^^ ^l^^l!^ 
floors or wa lls. Each mosaic is made up of a numbar of partially ^^^^^^ ^^IZaics 
pair are identical except for one square which differs in shadmg. The veruc^' task will 
ire labeled A to C A to □ or A to E according to the number of columns m the mosaic. 

o Se. fSJ each pairof mosaics, the cohSmn that contairs the single ^^^J^^^^^^ 
ferently. TTien mark the space on your separate answer sheet that corresponds to the letter at tne neao 

of ihac column. 



Sample Question 



Sample Answer 



ABO 



A BO 



IP 



m sample question 1 . the right=hand and left-hand mosaics are Identical except for the center square 
of column B, r,o answer space B is blackened in the sample answer. 



Sample Questions 



A B C 0 



A B C D 





A B C D E 



ABC D E 





Sa mple Answers 



IBS 



h, .amplu question 2. th^ hottom square in column D is the ono that is differci]t., so ""«^f j^. 
N blacken^ in the sample answers. In sample question 3. the second square in column A is throne 
is diffurent, so answer spnce A is blackened in the sanHilu answors. 

S;''.;;;" ^r^ "Jld to da so. - llememter only one square is different for each pair of mosaics. 



IX) NOT TlMsN 'riliS PAGli UNTll, VtX' ARIi lOLD TO DO SO. 

(This section contained 116 mosaic comparisons, 
divided into 3 parts as follows: 

Part 1 - 56 tnosalcs 
. . Part 2 - 33 mosaics . 

Part 3 - 27 mosaics 

...... 116 ■ ■■■■ ■ 
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The NLS teat battery includes Items from ETS tests 
which are in current use* 

To maintain the security of these tesfSp only 
sample questions from each section have been 
included here. 

Qualified researchers may write for a copy of the 
complete test booklet toi 

Dr. Hunter M, Breland 
Educational Testing Service 
Princeton, New Jersey 08540 
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Survey Administrator's Manual 



IMPORTANT 
Please read this Manual as soon as you receive It, 
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TO THE SURVEY ADMINISTRATOR 



This Manual has been prepared to help you carry 
out at your school the survey of the National Longi- 
tudina! Study (nls) of the High School Class of 1972, 
The survey m being conducted far the U. Office of 
Education by Educational Testing Service {ETi). 

The NL^ is described in the folder Natiunal Longi- 
tudinal Study of the High School Class of 1972 and the 
leaflGt Information for School AdministratorH. The 
project will begin with a BUrvey of students and 
counseiorH in 1,200 schools in the United States. The 
Ni^ needs the participation of 18 students and 2 
counselorj^ (where i>OBsibie) in each of these schools. 
The students will require ai>proximateIy two and 
one-half hours to complete a questionnaire and a 
short battery of tests, Coun^lors will spend 30 to 
40 niinutes filling out a questionnaire about guidance 
activities. 

The cooperation of the students and counselors is 
crucial to the success of the nls. However^ you, as 
the Survey Administrator^ have an even more critical 
role. In addition C > answering questions about the 
school and providing information drawn from the 
school record of each student invited to participate, 
you must see that all tasks are carried out so that the 
survey at your school yields the data it is intended 
to yield. 

This Manual eKplains your ^veral functions and 
suggests ways to carry them out efficiently. If, after 
reading it, you have any questions, plea.^ telephone 
or' cable ets. Instructiuns for communicating with 
NLS staff at ETS are given below. 

Communleallng with NLS Staff at ETS 

Please alert the nls staff at ets about any serious 
problem or question you may have about the survey. 
Call (609) 921-9000 collect from schools in the con- 
tinental U. S. and ask for the nls Project or cable 
from Hawa^ (eductestsvc). Normal business hours 
are 8:30 a.m. to 4,45 p.m. Eastam Time. 

Written communications and shipments of survey 
materials should be addres^d to Educational Test- 
ing Service, P.O. Box 2608, Princeton, New Jersey 
08540, If you spend any money for a telephone call^ 
mailing, or shipment in connection with the siu'vey, 
send a letter giving the amount and reason for the ex- 
penditure to the above addresa. You will be reim- 
bursod. 

prdparstlons to Date ^^^^"^ "™ 

Several ; steps havar already been taken by OTS, by 
your principal, and probably also by you prior to 
yota^ receiving this Manual; If there are any book- 
lets, memorahdai or other communications about the 
KLS you haven't already ^n, be sure to read them 
and confirm that all of the following actions have 
b^n taken. 



L The NLS publications previously mentioned were 
received by your principal in early March. 

2. By the first week of March, your principal (or 
you) sent to ets a Principars Reply form identi- 
fying you as Survey Administrator and specifying 
prefern?d administration and makeup f backup) 
dates betwTOn April 4 and April 21. 

3. Your principal (or you) sent to ht^ a roster of 
your students in Grade 12 (or equivalent) and a 
roster of your .^taff who arc assigned twelfth grade 
counseling dutius. 

4. About mid-Marchs eth mailed an Information Kit 
of nus materials to your principal with the request 
that it be forwarded to you. The Information Kit 
contains samples of thf* questionnaires, test book, 
and answer sheet. ^ 

5. A few days ago, you should have received a 
Sample Roster containing the names of students 
and coun^lors selected to participate in the sur- 
vey and 30 copies of the Student Invitation folder. 

If any of the ateve information was not supplied, 
telephone ETg immediately to see whether action 
should be taken to correct the oniiasion. Also, If after 
reading this Manual, you conclude that you are not 
able to meet the makeup date previously specified, 
promptly notify ets by telephone of the date you 
prefer. 

Overview of Sumy Administrator's Aatiyltias 
In April and May ISTi 

The following list outlines the actions you will be 
required to take during the course of the survey. 

1. Become familiar with the aims and procedures 
of the survey. 

2. Arrange for the release of participating students 
from classes so they can attend questionnaire 
and test sessions. 

3. Receive the Sample Roster and Student Invita- 
tion folders; invite students and counselors 
named by ets to participate in the study. 

4. Receive shipment of nls questionnaires and test 
materials. Return Materials Receipt Ac ttnowl- 
^gment postcard. 

5. Supply questionnaires to participating counse- 
lors; obtain their completed questionuair js. 

6. Complete (perhaps with the help of the principal 
or office staff) the School Questionnaire. 

7. Administer the Student Questionnaire and the 
t^t battery to participating students. 

8. If necessary, arrange makeup session (s) for stu- 
dents to take the teats and complete the ques' 
tiomiaire. 
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9. Cumplote (perhaps with office staff help) a Stu- 
dent's School Roc'orci Information form for each 
student invited to participate in the study. 

10, Promptly return all completed questionnaires 
and test answer sheets to ets for proce^ing. 

11, If requested by ETa. supply or ask counsalurs or 
students to supply omitted data; forward thtise 
data to ETB. 

12. If requested by ets, arrange for an fts represen* 
tative to visit your school to appraise the valid^ 
Uy of the data; assist the visitor as required. 

Each of the above functions except the first is de- 
scribed more fully in the sections that follow. 

Admlnlitrator^s Checklist 

On pages 16-17 of this Manual you wili ftsid a de- 
tailed HcheduJe of Survey Administrator's tasks. A 
Bpace is provided opi^osite each item for checking off 
each task when it is completed. It will facilitate your 
work if you review pages 1 6- 1 7. frequently and keep 
the record up-to-uate/ 



PRlLfMINARV ARRANGiMENTS WITH 
PRiNCIPAL AND STAFF 

Once your survey materials arrive, you must proceed 
immediately with the detailed plans and s|>ecific 
arrangements for all of the tasks that are to be 
nerformeci. 

Hisvhw the date^ ^nt to ets on the Principal's 
Reply rbrm, Ee certain that ail data collection at 
^,w^r ftchool ca.\ be eornpleted by the makeup date. 

''.^hv nios^ w.ho.ent way to handle the survey at 
y. ur sc hool wouid be tu excuse participating studentH 
trom classes ana other duties for a tliree-hour period 
during which the tests would be administered (while 
the students are fresh) before the questionnaire. 
Total test administration time is 105 minute, in- 
chiding 10 minutes for distributing materials and 
reading initial instructions, 16 minutes for reading 
Instruc-ticms for individual tests, five minutes for col- 
lecting answer sheets, and a five-minute rest at about 
the half'^a'^ point. The a<^tual testing time for the 
complete battery m 69 minut-es. The time required 
for <'onipleUng the Student Questionnaire ranges 
ffs^r"! 35 to 60 minutes 

If participating students cannot be released for a 
f jjorind, schedule two shorter f?eriods on 

^iii^et'u^ivo days. Administer the Student Question- 
• lalre on th^' t^r^t day and the tests on the ^ond. 
Kstablish the necessary procedures (for oxrimple, the 
i*4finng of passes to participating students). 

You must be able to give definite arrangements 
jnd^ procfidures to students at the time you invite 
them to participate in the Ni^ project page 7 of 
this Manual), 



You should also artange for 'a room for the test and 
qu^tionnaire administrations, Make sure that iK'-ir- 
Mical factors in the room, such as lighting, heating, 
and ventilating, will be reguliited so that the ntu- 
dentsare comfortable and able to give full attention 
to the t^ts or questionnaire. The room should be in a 
location from outside disturbance. The situdent 
should have both hands fr^ to deal with a test book 
and answur sheet. If possible, each should have 
enough room to read the book and mark the answer 
sheat without having to pick up or shift either one. 
Most auditoriums are not suitable t^tmg rc^ms be- 
cause of deficieiicte in the factors mentioned atove. 

You may or may not need help from the principal 
or the school office staff with the &hool Qu^io a- 
naLre (page 7) and the Student's School Record In- 
iformatlon forms (page 7). You will be able to judge 
your ne^s after reviewini these materials and the 
pertinent school records/ Make ^rTangements 
promptly for any help you do nt^. 

Reeelvlng iurvay Materials 

This Manual should hsive reached you with the main 
shipment of survey matedais. Prcmptly check its 
contents against the Survey Administrator's Control 
Sheet. If you find any discrepancy, telephone or 
cable ETS immediately. Then coniplete the Materials 
Receipt Acknowledgment postcard by entering all 
required information including the School Coda (the 
S.C. number on the Control Sheet) and mail it to 
ETH. You should have already received by fiist class 
mail a large envelope conteining the Sample Roster 
(in duplicate) of students and counMom to be in- 
vited to participate in the survey, 3u 'copies of the 
Student Invitation folder* and a memorandum en- 
titled *'Inviting Students and Counselors|t6 Partici- 
pate in the National Longitudinal Study." It you 
have not received the large envelope withiii two days 
after arrival of your survey materials, telephone or 
cable WTS. ( 

Storing Survey Materials 

After checking your survey materials, store them in 
the shipping container in a closet, cupboard* or safe 
to which only you and authorized persons known to 
you have access. The test battery must be kept :se- 
cure to insure accuracy of Ni^ results. All materials 
should be on hand when they are needed. 

Obtaining th@ Cooperation of 
Couniolors and Students 

The names of the students and counselors listed on 
your Sample Roster were selected according to the 
principles of random sampling from the complete 
rosters of students and counselor supplied to etk by 
you or your principaL They are not intended to Ik? 
reprasentative of your school or of your senior c-lass, 
although fn many cases they will be. The aggregate 
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?i^impte in all 1,200 participating sehoots is repreBen- 
tative of schooK rounseloni, and students through- 
out the nation. To retain the representative quah'ty 
of the mmple. it is vital th^it the students and 
i*ounselon4 listed on your Sample Host«^r partidpate 
in the ,^tudy. The imi>ortance of the Nt^ to today 'h 
youth and to the tKlurational syHteni and the unique 
t^ontribution each individual run make Bhouid be 
imprernxJ upon aii those invited to participate. 

Although partidpation in the study m entireiy 
vohintary* it m important that tht^ largest |«^ible 
nwmber of the selected j^tudentn nnri oounsalom a<r- 
cept the NLs invitation. One of your primary func- 
tions as Survey Adminmtrator wiU ha to pr^ent the 
case for participation and obtain the cooperation of 
thone invited students and couniHtMors who seem re- 
luctant to become involved in the project. If d^pite 
your best efforts you encounter unusual difficulty in 
obtaining the cooperation of the.^* students or coun- 
seior^H, teiephone eth. 

Inviting Counsefors and Students to Partlefpate 

Immwiiately after you examine the Sampio Roster, 
invite the listed counselors and students to take part 
in the survey. The memo that accompanied your 
Sample RoBter contains detaned instructions for 
extending these invitations. You will probably wish 
to meet with the counselors to give them an oppor- 
tunity to discuss the survey with you. If they wish* 
counselors may review materiaU received from ets. 
Distribute a Student Invitation folder to each stu- 
dent on the Sample Roster to supplement your own 
remarks about the importance of participating in the 
project. Let students know that copies of the qfues- 
tlonnaire are available for inspection at school and 
at homo and provide copies for this purpo^ to stu- 
dents who ask for them. On the Sample Rosten re- 
cord date of invitationi act i^ptance, student r^eipt 
of the questionnaire, and test administration, (Keep 
tlie two copies of the Sample Roster together so that 
both will show any notes you make on the top copy.) 

At the time a student accepts the invitation to 
participate In the nls, repeat the time ar^ ^ace of 
the scheduled questionnaire and test session (s) and 
explain any arrangemente you have made for stu- 
dents to be excused frpm classes in order to attend. 
Tell each student to bring his social security number, 
and several No, 2 pencils to the t^t session and th^e 
items and his driver's li^nsc number to the ques- 
tionnaire administration. 



COMPLETINQ THE SCHOOL 
QUESTIONNAIRi 

The Scihool Questionnaire asks questions about your 
schools locale, enrollment, ethnic makeup, staff, ser-. 
vices* facilities, practice, and programs, and also 



about certain kindn of student results. Taken to* 
gether, the completed questionnaires of the partici- 
pating schools will yield a profile of the American 
m-ondary school. 

All, or at least must, of th- informatiori required 
fur the School Questionnaire hag probably been 
complied by the principal or another administrative 
.staff meml>er. The amount of help you nc^ed in com* 
^lieting the S<-huul Questionnaire will dei>end upon 
the availability of such data. Work on the School 
Questiojinaire slujuld bepin immediately. 



COMPLETING STUPENrS 

SCHOOL RECORD INFORMATION FORMS 



A Student HScht>ol Record Information form w ill be 
required for each student invited to fjarticipate in the 
study wheiher or not he actually accepts, (All data 
supplied on the^ forms will be held confidential, as 
explained IhMow.) Work on th&^ forms should begin 
MS soon ns you receive your Bample Roster. The in- 
formation asked for can \m drawn from a student's 
school rec ords either by you or by a member of the 
m^iooi oilice staff. If several iH^ple work at this task, 
you must make sure that all of them follow the same 
procedures for researching and recording data. Re- 
view each form for completeness. Note on the Sample 
Roster the completion of each of these forms. 



AD^INISTERINa THE COUNSELOR 
AND STUDENT QUESTIONNAIRES 

Confidentiality 

It is important that compieted Student and Counse- 
lor Questionnaires be examined by no one except 
elected WTB data-processing perSonneL Therefore, 
WW has provided a Confidential Qu^tionnaire Re» 
turn Envelope for each participant. Th^ envelopes 
are marked TO be opened only by educational 

TESTING SERVICE H\M PROJECT MATEKIAl^ CONTROL, 

After the participants complete the queationnidres, 
be certain that they place them in th^ envelopes 
and return them seal^ to you. YoUj in t^n, will re- 
' tum them sealed to ETS. 

After initial check-in at ETS, questionnaires will be 
identified by numtor only. One name-number identi- 
fication file will prepared and held in ^ure stor- 
age. The file will contain the names and numbers of 
only those students who complete the qutetionnaires 
or toke the tests. Names and numbers of students 
who do not accept the NLS invitation will not appear 
in this file. The file will used only for adding in- 
formation to the main data file* There will no pos- 
sibOity of associating any person's name with any 
subgroup or with any item of information, 

99 ^ 



erJc 



Counseior Qiutstlennalfes 

Prt»|)art? a qucBtionnairo envelox>o get for each par- 
tiiipiitinpi rounselor by ^nterinp the? Srhool Name, 
Si'houl CMi^. i\nd Coun^or Number ffon\ the Sam^ 
pit* Rosttir on the cover nf the Caunselor Question^ 
naire and the &hool CotU- and Counselor Number on 
n return envelopi.*. Give the appropreatu set tu each 
4MvunHiL*Ior, Tht*^e que^tiiiinnairGs are Helf-adnunig- 
tered. Ank the rtiun^clor^s to return the completed 
queHtionnaireH to you vn the sealed envelopes within 
three days. 

Student Queslionnaireii 

Prepare a questionnaire en^x'eloi^e mi (or each stu- 
dein who ha.s agreed to participate. Enter the Stu- 
dent Name, Student Number, and ycvur Bchoal 
(^ode rmm your Sample Roster on the ec/wer of the 
que^tiunnaire, Enter the School Code a^ad Siudent 
NumlHT on page ! and al^n on the return envelope. 

Have Heveral No. 2 peneilw and emHern and a penrll 
Hharpener at the quetfUnnnalre ¥em\m. At the ■fH^Kt^ion, 
distribute the appropriate queHtionnaire envelope 
iietH io the student^^. The questionnaires are. htr the 
most part. s<*l^adminiHtered, but you nhould read the 
dim-tion^on page 14 of this Manun! to the students, 
answer any questions they may have, and nionitor 
the rooiu to mahuain order and insure jiest resylts, 
llrse ilie students to \w alert tn the routinR direetions 
in th*^ jater sections of the ciuestiOFUKure. 

Ouestiortnasfe Makeup Session 

If any students niiHS4Kl the questinnnaire admEnistra- 
tion/arrani:e for them to attend a makeup s^'Shiun, !f 
;t studiMit i anniit ntiend ihiHi st^ssion, i)e iniiy \ om- 
lAiAv the (lUcKtionnaire iwUm^ the makeup chne. If he 
likely to iH'ed hi^lp in eoniplellnii i\w cpiesl innnaire, 
arrange Us \w present wheii lie tills it out. 



GENERAL iNSTRUCTIONB 
FOR QiVING THE TESTS 

Hi'l(.re the testing session, Mm\y thv IMniet^hle for 
Achniruslerina 1Vsls Mn<l t|uesl ioniiiiircN uu paMi' 
I'reiKirr an a.nswi'f sheet Un eaeh HtiidtMit hy tMiteranM 
\\\v Sc'ilool Cudv. Student Narnis HcIuhi! Nanu', and 
Htiident Nmnher. 

SuppliDS You Will Need 

When you admiinsttT llu* tests, yu\i should provide 
tUi' Inllowinj^; 

A rrliMhle wateli mot a stop watch or any other 

iruM-hnnirnl timing dc^vietM. 

A eloek alarm rhirk size or larKUrj, if posHbhs iu 
the i^VL-nt that there is no eloek m the lestm^i njom. 



(Thcru should always bo two iimepieee^ in the 
room as a cheek 10 [jrevent misliminc.) 
Several No. 2 ijeneils and erasei^ and a 
sharpener. 

Sealing the Students 

Please follow these gutdelinos: 
Seat the students randomly a^ they enter the 
room. Do not allow them to select their own seatj?. 

. In a elaBsroom. seat students in alternate rows; 
if gpace FNjrmits, leave every other seat vacant, 

1^1 a cafeteria or library, seat students so that they 
are at least five feet apart. Candidates should al^ 
wayB be .leated so they face the Batne direction. 
Seat left-'handcd students one behind another in 
a separate row or in the last seat of each row of 
riglit-handed students. 

U chairs with right^iand tablet arms are used, a 
left-handed student should be seated so that there 
is a vacant ehalr to the left (or his use, 

Regulatloni In Ihe Testing Room 

PROHIUmON OF BOOKH. RIJLERH, AND OTHKR AIDS: 

The students should have nothing on their desks ex^ 
eept tfieir test books, answer sheets, nnd several No, 
2 pencils; they may not use lexi tooks. notes, dic- 
tionaries, rulers, compasses, protractors, slide rules, 
or other aids of any kincL 

HcuJTiNE A^^ENCKs: Routirte absences to go to the 
rest room unlike other absem^es that will be dis^ 
russed below need not bi? noted in your survey 
records. No extra testin« time may l>e allowed lor n 
routine absence during a timed test period, and two 
mo^e students should not leave the room at the 
same time. Collect the ti^st book mnd answer sheet 
fram any g^tudent r)ermiiti^d tn. leave the room. He- 
turn the same test material to him upon his ri'turn, 

Prsblams You May Encountaf iri Giving lha TasU 

If ^iny of the fVililowiiig problems oeeurs in ( iinnertion 
with the tests, it sliould be reporti^d on the l^roblem 
Imident Bhc^el ineiuded in this MunuaL If you need 
more s|meo than is pn>vided, attach additiunal sheet>^ 
to it. Be sure to indicate the tesi section in which any 
problem occurred a iid to fill hi the identifying infi>r- 
niation. ^Phe ProbU-m IniMdeiit Hheei will wnrfi CTH 
mf inc^idents that mi^ht ufTect thedntj^ Kyout^xprnv 
(■•nee no i)roblemH itv administering the tesis, write 
N(JNH oin the Prnhlem hu^dent Hheet and iill in the 
icli^ntifying informatiui^ Return the shecH to kth 
with the eomplcted questionnaires and answer sheets. 
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GHOUP MlKTiMiNt*: Ht?iJ<jrt all mwtimingi^. Vonvvi 
any undortimiiig bvfurr yini cJismisH the Htudoiits, On 
receipt of a nimtiming rv\mri, kih will dtn icif if an 
overull adjustnient of m*tyrv^ should be mndu,, 

EmkkgeKCIEH: EinergiMirioH Hurh an jjosvor failurt', 
fire, or any otlwr event Omi d'minxvi^ the* Htudc»iUH 
should bo foportud on the Probiem Inridtmt Shwt. 
If, in your opintnn* the c-ondition Ia likt'ly tn ad- 
vomMy iifTect Hftuk'tit {5crfornunuH\ movv the stu- 
dents to nuother tenting phu v, 8tudunt«4 should not 
.^-i>enk to one nnotlier during the inove if it oreurs 
while the te-^t adnnnistnitiou in tn pmgn's*^. If ytHi 
are not able io * ontinue satisnu't«»rily hi I lie oriuin;d 
loeation or in nnother loeation. hcrlt the adniini^-trM- 
tion. and HchtHhile n mnkeup set^^^ion. Telephone ki h 
idxjut any problemH or uneertaintieH rt^uarfiinK the 
resuniption of testing. 

DKFECTIVE TEST MATKHIAL^: If a gtudent has (I deflH^' 

tive tost book, you H-hould colleei it, give hint a new 
test iKKjk. atid direet him to eontinuG workinK on his 
onginal anssvur sheet. On the eover of the defuetive 
te^t IxKjk, print the words DKFKei IVK mai khi/wu and 
Ind irate the nature and location of the error and your 
school code. Heturn the defeetive te^t btiok Ii^ the 
shipnicnt to Kis after the test administrntion. If a 
student indicates he has n defective answer sheet, 
give him a new ooe and dirrn t him to write only his 
name on it and continue working with \l, starting 
^ith the next question or the one he stopped wcjrkiny 
on, Rejiort ail such instances on the Problem Inri- 
dcni Slieet. 

CTUDENT Mlb^rrMlNc: if you find o student working 
on a wrong section of the test, instruct him to l^ni- 
ceod to the correct section. Re<ord the identifying 
informatiori for the student and enter: 



Worked 



minutes on section 



. of 



test: missed' the time on section 



ABaENCE DUE TO iLLNESs: If a student becomes ill 
and must leave the room during the test, collect his 
test book and answer sheet. 

If he is able to return and continue testing, give 
him the same test materials. If hu has mi^od a sub- 
stantial portion of the testing, you may prefer to 
have him report to the makeup administration and 
work on those HtH tiona of the test he missed, at the 
time the other students take those sections. If a stu- 
dent is unabli^ to return to the test administration, 
notify him to riMwt to the makeup ^ssion to take 
the t^t sections he missed. 

In any ca^, record on the Problem Incident Sheet 
the identifying inrormation and the test sections that 
are Incomplete because of his illness. Enter: 

*'Left room after minutes of testing, 

ftesumed testing on or at (date or time) ." 



HTHKH rHiiiU.KMH^ A studenl may niiHtakenly mark 
hiH anHWerN on the wrung st^etion uf hin answer sheet 
or hi hin test iKSok. All^ueh case^^ reiiorted or doteeted 
Hhould Ih> eniered on the I'rtiblehi Ineident Sheet by 
reconiing the student s identifying information and a 
hrier explanation, Attneh tlu* ivM book (if it is 
mnrked} ^o tin* Problem Ind(h*nt Hheet for return to 

Collecting Test Maiterjafs 

At tlu' end of the it'^ting soHsion. i\TM i Mvrl the tesi 
bdnks anci then the answer sheets. Ho not allow a 
stiideiU lo exuniine a lest bnok or asiswer slieel afUT 
it ha^ Imh-o returned to you. As sim are^'oHeciing Ihi' 
test IfMHjks, hrive the H^udents i beek their unswcT 
>5heets to make sure tliat the identify iiig iviformation 
is I'orrci't , 

Bcfcjre g<)ing on to administer tiu*^ qucHtionnciire 
to dismiss the students, t ciuiit test boi^k^ ^ysecl. 
unused^ and defective? and nonfimi tlwit no^i^e is 
niissfng. 

SVhen all test mnterinls are in your posser^ion* 
ph'ast* thank the students tor partiripaling in the 
NLK. Then read the direr! itins Ibr rompietlng the 
i|ueHti<HHuiire or diHiniss I he stuelents. Return the 
Lest materials to locked storage unti! they are ready 
to In* sent to kth. 

Test Makeup SeSilan 

As soon as the test administration has lieen com* 
pleted, advise those students who missed the session, 
or who had to leave l>efort» the end of the sesgion, of 
the makeup date and obUiin their conlirmatiiin that 
they will attend, 

'rhe must im|>®rtant obji*ctive of the survey is to 
gather com|>lete data from students and counsel ots 
in your sample. If, to achieve ma^clmum participa- 
tion, you have to m'hedule a makeup date later than 
the one orlginaliy announced^ try to schedule it lie- 
fore April 21; In any cases telephone BTs promptly. 



ASSil^BLINa AND MAILING INST RUCTIONS 

Survey materials should \w assi^mbledj che(*ked, and 
returned to eth as soon m possible but nol later than 
five days after the te;it makeup administration. 
Check all completed Stwdent's B<'hool Record Infor- 
mation forms to be certain that a fornt has been 
completeci for each student on the Sample Roster. 
Count all answer sheets and all envelo|>es containing 
Student Questionnaires and Counselor Question- 
naires. Indic*ate on the Roster tlic items received 
from each student and counselor. Place all the an- 
swer shc^tsi in the single Answer Sheet Envelope. 

In the carton supplied for returning nlh materiids 
to KTS, place the fojiowing: 
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i c i*py of thu Sample Hoster 

All rompleted Student Que^^tioniuilruH, uach in Us 
own ret urn envelojie 

Ail Counselor Questionnaires, eaeh in its own 
t Bi'h.ool Quostionnuire 

All ronijiluted Studenl*^ Srhool Recnrd Infornm- 
tion furm^ 

Alt coinpletud anj^wcr sheetH^ in thu single Aiiriwur 
Sheet Env'elo[H? 

Any defective test bsoks and aiiy test books c^on- 
taining snswerH l^e r)nge ^) 

I'roblem rncident Sheet 

Aitiu h to the earion ont3 of the shipping Inbols you 
rtH'dvtMl in your mn in shipment of survey materials 
and Ht^nd tlie t arton to kth. Complete the Notifica^ 
tion |K>st4Uird and mail it to kth. 



FOLLOW-UP 

TO OBTAIN MISSING DATA 

The Hii4 Projert MateriaU Control stafTwill promptly 
review the reituirned questionnaires and form*4 for 
(omplLttene^^ ™d will n^k you to reciuest studentH 
and (vninselorft to supply any informaticm that ap- 
pears to have l>eim inadvertently omitt^^d. You will 
not aski-d to iiirj^e participants to mipply informa^ 
tifju tht^y art? reluc tant tci provide, 

TVa^ initial shipment of survey materials l^icluded 
^uilii itMit supply of fpiestionnaires for f^iUow^up 
wnrk \\\ however, you Hhould dlsrover that you.need 
ninre copies of any itent. pieast' call Km for Mlditional 
suriplies. !-repnre n questionnaire envelope ml for 



each counselor or student who will supply missing 
data Obtain their numbers from your t opy of Uiu 
Sample Roster. Ask the students and cmmsclon^ to 
seal their questionnaires in enveloi>es. Forward all 
matofials containing supplementary data to bth m 
the large 13") fbUow^up envelope uicludod v^ith 

the basic shipment, ots will process the^ question^ 
naires in the manner and with the confidentiality 
provisions described on page 7. 



DisPosiNa OF suBvey matebials 

After the test makeup adminiitratlon, burn or shr^ 
all te.^t l>ooks except books to be returned lo wtb. If 
it IS not fcasible to shred or burn waste mat^nala at 
vour school, return the 20 test books to wv^^ Do 
iend the ^oks before May 1. 1972. Use the second 
ship|)ing label you recmved with your survey mate^ 
rlaln on the carton containing the books, , 

Do Tiot disiwse of copies of the quest ionnn ires or 
other NLH materials until rrs notifies you that data 
eollection has been satisfactorily completed at y^ur 
Hchooi QuestionnaireH and nus materials other than 
t«st books may be diHiK)sed of by any convenient 
rneans. 



VISITS TO SCHOOLS 

In u.aer to confirm the vaHdiiy of the collected data, 
KTs will visit approxiniately 5 percent af the partici- 
pating schools, i^hosen at random, at mutually con- 
venient times in April or May. If your school is se- 
lected for a review of this kind, you will be notified 
by telephone and requested to hehrwlth the arrange- 
mentH for the visit, - 
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Oit^lLED INSWTIONS FOR 
QIVINQ THi TESTS 

m Mm. ik mtv l(j mi Ihiso inHlruciionH 
aiily Mm yuu dmM^ tlif 
iHlriilKin. rwtd :il"iitl In tlinliiiilH hH diwlbs 
in hold fact'. Alli w t iitu' tif itroifdure kmU 
lii 1)0 i-irrii^i iHil. D" not dfpwt fmni tliOS dirii^ 
iii)iiM)r atiswcr iitiy tjuuiilitjii wpciiii^ \k mMi 
(if lite tvfit?i. Tfe ftil! itiJ^«"- tii'i^ ^'ii piirliiipiinl^ n' 
llip survny taki' tiii' inb under tlif ^ime coiidiliDii^- 
When nil ijluibis livo ten AM nnJ ^atcd 
as illri^dwi ill "Hi'silin^ the HtudeiitH" on m ^ ^ 
thin Maniiiil, MM^ m mm M Id ^ 
^tiitii^it. Aftor till' iinjiWDr shents have ten dWril)^ 
uliiliertinlbt each slate 



Wlicn the studciit^ have had liiiie to look at the 
an[;wi)rte(.tf'lllhoin llio Iblliiwing: 



Ml of^oii^vill bf given a lost book, llm do not 
understand ail of thf dircelioni lof cich scctiDn, 
pjeasu raise your hand. Queitioni will be aniwered 
between sections hut not m work on any ene 
riontebfpn. There will be dve-^^^ 
halN through the tffits. Wh«n you receive your ■ 
lest book, read the directioni on th€ bick mm 
and look at me when you hive Unliliii Po mi 
Uirn your teoNvur or open it yiitil yoore told 

tpdaso-ArelhsfeanyquestW... 

Be sure thst for « ipacHf booou M ^li^ 
nufflkr on the hmm sheet coriv-sponfe to ik 
numbef of the question you arc mmH ^hcn 
you in the bm on the answer iheel, dBrkoii the 
ENTiRE If P change an answer, eraie your 
first mark completiflyj incomple^^ 
rcida8lntcridcdreipD»Donslfnaks^ 
ntarki on your answer iheetJemfrnbert^ 

ingihu timo allowed foronertn or part, P 
mayworkDnlyonitJonot^oonioiiiyBtharioc^ 

Hon or part until you ifHold to do 10. 



niiringtlH'^idmiiiii^tMtHiiHifiliN 
lli(*n!!Hnt!i!niiiiuAirHhiilftri 

(;tj(hp;,p|,P!,|,rii!teHidta 

|{x;!H!yiiV(MiHnuli'Hliili'Mi(y; 

PbNHiJip work. 

Mm Ul%in''S\mkf 

fk I'letaft-Nunibpf test ifi dii'idrd into twfi p^rtli 
i)f niiiiiili'N mh: Each part is further divided 
intuii ihriMiiuti'iijpi'nl fur study and a two- 
niinuli' sipii'iU k mm ^^^^H ^^'^ tim^ 
iilluwi'il k m m stpi^it, you tiiny ivork only 
on thill fiipint. Bead ik imim m page I 
siliMitly n 1 mA liieni aloud, Do not turn the pap 
lobcpthutmuniilllL'llyouidoso. , 



This is a mi of your Bbility lo ri'inumbfr picture^ 
numbur ccmbiiiations. Tho mim\ has two parii= 
In I'acb part you uill stiiily a pagi' of piclurus 
with numbm, On a study pagu the pieiuri!'num' 
byr paji'^ vvjillflok like the uxamplifs tji-ln^v. 



the plcturei in a different ordor. i^ooli at the fellow- 
ing ^Kamples. 



On your ihiiel iheri' ire 10 bq^ei with Epetly II minuter m ' 
mimbori afetivc them for t'lch questiuii. i)m of the 
nnmbcfi will bi? the nuniber that goui with the 

piylur^. You aril lo hliickon tli^ kt M that ^top work, Ctee youf hool^ and ^ » 

m\\\ki abmi^ it. See biiw Hit mmj^h aff lopofyouran^tti'riihiieti 

marked. 



! i. ] 1 i 



J U J 



Thv niiniha Ihiil gooii willi tln' mWm of a tHi" 
phoniMHf;!, siiliir cKHnipk I m ^^I'lfid ^J''*^^^''' 
bui with ?;{ iibove it. h' Diianiiili' !! ymi «uu!d 
hliickut) tho bus iuih ;ll abovo it. For vm0 ;l yuu 
wdiild bliiiikj'!! llii' hi with 16 iibijvc li Ari^ tluTi' 
iinyqiiciiliiMisf ..,Vmi ^illliKvi'lhriT miiuilj'Si to 
jiiiidy Piirt I. '\m to jia^i' ^ thi' ^liidy piigi' f*'!^ 
Piirl Mnd?!l!!dy il!ii»Hiiri'^»uii)luTpiiirs. 



l^pillylliriT iiiiiuil!^?iliiii'r, m: 

Yml dlliihrlHii iliilillteMo «wkl!!i piiKi'Mi'i' 
lBl|jiiir,:fnr|';iill/rimUn|lil|'vlillldbi'^^^ 



N|iH)\M)iiVim^Mllli^u.lliiTi- illiiUlli's lo 
simly Piiil t Turn ill pii^HMhp Nimly pir f<"' 
Piiri % iiiidiitiidylhi'pirUiiT^niiiiiliiT [iHihi 



laiiik llimMiiiiiiiir.^bii^rs;i\ 

Villi iull liiml^iiminiiliMiMuirkdit iniHi' lii, lliv 
l,,([M|;i'f(irhiil^/l'!iil!i!'|n'ii''i:^^ 



Allow the studeiits abiit five iiiiiHitt^ ^^^^ 
tinie^Youniaypernytlhcnitol^iiVHlii-rooa 

hM tiiiwbetathedrftherit pdod. 

10 rnnni and ^ay: 



siinin\i*!i lilt' 
M^yunrMHndgtl ready to reiunie^vork. 

U will li.v.l^f!luiuteitqwgrkon ^^^^ , 
LHtidimiip. Turn lu page le in your Id book 

„id rv^d the directions #ntiy a^ 1 read m 
HluudJ)oiintturlUhepagi4ohciinthetc^ 

ltdlyouludom 

IMfim- . . . ■ ; ■ 
HafhiiHestioiiinlhl^simionciinsiHisoffivu 
ofleltrrswith brloitmin i'ach pup. i^ourof 
ih.^nrtip8liHv.Mid)aract?risticlnconun 
tlw fifth gruup does not ImlMewhlfh pup 
isdiirereni and blacken the pCHm ihi^ ar« 
m ihaimpondUotheposilinn4,lM'*lJ. 
ifrH nfyuurehoicf. 

Sm Tlu' crtinmon chariiftt'ristic will NOT be 

haduntlieHOiifidsofpupsoflctterH^ 

,f i,iti,fH, ur whi'ther letlvr forabiniitionfi fbrni 

,,,|,,,,p;,rlMifwdd.«iikatthe^an^ 

\\m iind Siiinple ausuefii. 



A ! I 
I m'H \A AiH'i) 

L m m qi'iH 



tivwx 

VlJIi 



Find the area labeled Section l-Vocabulary on 
yByr aniweriheel. In your teit book, thiiectlon 
nurflberwillappearintheupperwrofthepip, 
Iffiamsll number appears to the right of the le^ 
tignnuinbor.Niilwfwie the part 
lectlon. You will have M mmmiQ work on 



, 'ififi J limhHij 



Villi ^S !^ mihiitr^ til mi <iii ^I'^'ii"" 
Hi!' dii'iTliitiis iiiiil bi'iiiii sliifL 



12 
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In siimpU* qumion iVthu iellijrs in rour of the 
groups art» in coiisi»cutiv4* alphiibrticai ordi^r^ hut 
group DEFL in rolumii B Is not; §o spacu B has btH»" 
marked in the samplo »nswurs. In sampU» qucgtiDn 
2, four of ihi* iirinips contain thu letter L Uvtivr 
group TIIIK in column D U the group thul in 
diffcnMit, Kpact* n has been marked in the 
sample answer**. Are there any qiioslions? , -. . You 
wili ha%e 15 minuter to work on ihxn nection. Turn 
the pagv and begin work. 



Exactly 15 minuter later, nay: 



Answer C marked In example I sinct* the quantity 
in Column A is equal to the quantity In Column B. 
Answer A is markud for example 2 Pince the quan- 
tity in Column A is greater than the quantity in 
- Ctilumn B. 

You will have 15 minutes to work on this section* 
Are there any question^? . . . Turn the page and 
heginWnrk, 



Kxiictly 15 minuteH Inter. Hay: 



Please stop work. 



Please stop work. 



Svrthin .'f^MnUtvniaiirs 

Turn to the area of your answer sheet labeled 
Seetion 5— Mathematics. Ymi will have la minutes 
to work on the Mathematics test. 

Tur" to page 21 in your test book and read the 
directions silently as I read them aloud> Do not 
turn the page to begin the test until I tell you to 
do ^o. 



Each problem in this section consists of two 
quantities, one placed in Column A and one in 
Column B. You are to compare the two quantities 
and on the answer sheet blacken space 

A if the quantity in Column A is greateri 
B if the quantity in Column B is greater^ 
C If the tvvo quantitiee are equal; 
D if the size relationship cannot be determined 
from the information gi%'en. 



St rtiun fl -^,\Iiisaic ( itniparistins 

Turn to page 2*> in your test book and read the 
directions for Hectlon fi--Mosaic C^omparisons 
silently as 1 read them aloud. 



This test congiits of pairg of mosaics, that is, 
patterns of squares like those found on tiled floors 
or walls. Kaeh mosaic is made up of a number of 
partially shaded squares. The mosaics in each pair 
arc Identical except for one square which difTers in 
shading. The vertical columns of both mosaics are 
labeled A to C» A to D, or A to K according to the 
number of columns in the moiaic» Your task will 
he to locates for each pair of mosaics, the column 
that contains the {single square which is shaded 
difTerently. Then mark the space on your nepafate 
answer sheet that corresponds to the letter at the 
head of that column. Look at Sample Question 1. 



Look at the jiampi© questions anJ sample 
an severs. 



Sample Questtnn 



Sample Answer 



EXAMPLt: 1 
KXAMPLK 2 



Sample Quest iam 
Column A Column B 

20 percent of 10 10 percent of 20 

6 M 6 12+12 



ABC 



A 8 0 



Sample Anmuern 



I. 
2. 



A B 



mmm 
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In sample question I, the right-hand and left- 
hand mosaics are identical except for the center 
square of Column B, so answer space B is blackened 
in the sample answer^ Look at exaniples"2 and 3* 



/a 




4 BO 0 



Sample Questions 

4 B C D 





Sample A nswers 





JIB 






ILiJ 





In niimpW question 2, the bottom squaru hi Col u inn 
D \h the one th'^t is different, so anHwer space I) is 
blackened in the sample answers. In sample 
c|ueMtion 3, the second square 111 column A i^ the 
one that is differviit, ho answer space A Is hhiekened 
in the sample answers. 

There are three parln li> this lest. All thi- mosaies 
in a single part are the same si/e, lUirinjc the three 
minutes allowed for each part, yo'u are to work on 
that part only. Do not move ahead to the ne^tt part 
u II til you are told to do so. Remember only one 
square is differeiU for each pair of mosaics. 



Are there any questions? , . You will have^hree 
niiiuites to work on Part L Turn to paM»' 27 and 
ht^gin work on Part I on your answer sheet. 



Kxaetly t!in'** tniiuitrs later, my- 

Stop %\ork. Vou uilt have threi^ minutes to work 
on Part 2. Turn to puge lU) and begin ^\ork on 
I>aft 2 III! your ans%\»^r sheet. 



DITAILID INSTRUCTIONS FOB 
ADMINISTERING THE 
STUDENT QUESTIONNAIRE 

When all students have boen admittod and seated as 
directed in ^^Seating the Studenl^^^^ on pa«e 8 of thm 
Manual, make certain that uach Htudent luis the 
ccjpy of the quostionnaire and the return envelope 
you have prepared Un liim. Then read the explana- 
tion exactly m it in printed. 

The only right answers on this questionnaire are 
those that reflect your own goals, experiences, and 
attitudes. In no case will the answers of individual 
students be single^ out. The results, in the form 
of statistical summaries, will be used for research 
purposes only. If you are uncertain about any 
question, please raise your hand and 1 will try to 
help you understand what is asked for. Read the 
directions inside the front cover silently as I read 
them aloud. 

HOC^IAL KKCUHITY NliMBKB. If you have a social 
security number, enter It in the spaces provided 
cm the inside front cover. . . 



i)irvrl iiins 

, ThiN questionnairt' is divided into sections of 
que^ftions. All students are asked to start by 
answi rliiii questions iii the sections lettered A, 
B, and V. Then you will he asked to follow the 
directions to ans^ser questions in the sections 
that apply to Vt)UH paitieular plans for the 
yviir after you leave high school. 

• Ri^ad earefully ALL directions f*ir each question 
you answer. It is important that you fcillow 
these diri'Ctions carefully* 

* When you are asked to circle a number, pleaHe 
make a heavy black circle. Look at the example. 



KxiH tly ihrvv rninuteH later, say: 

Stijp wiirk. You ^^ill have three minutes to wuiife 
on I'iirt IL Turn t*> page [12 and begin %^ork on 
i'ari If on your anNwi'r sluM t. 

ICxat'tiy three minules later* say: 

Please stop work, 
Collect ti*Ht materials (see paRC Ok 



What ^rade are you \\\! 
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(iradi* H 
(;rafli> in 
(trade 1 1 
(irade lU 



i(*irel«* «^ne.) 
I 

2 
•a 

® 



. Circle as many numbers as the dirt'Ctions indi- 
cate for eaeh qu4*stion you answer, 

* Completely erase any answers you wish to 
change. 



When you havt* complutod the questionnaire, 
put it in ihv vnvelopv that has heim given to you 
and neai tho envi*!opo. No one at your school will 
soo or read your answt»f»= 

This qut*f5tio*iniijre is not a test. You may omit 
any question that you or your parents would 
consider ohjectionable. 

On pape I cniter the following; 

SEX, fMrt'li' the appropriate numher to indicate 
your sex* ... 

DATE OF lIlRTli. In the ipaces provided , enter 
the numbers Indicating the month, the day, 
and year of your birth. ... 



Now tell the studentH to fill out the questionnaire 
on their own. 



TIMETAILE FOR ADMINISTIRING 
TESTS AND QUI STIONNAmiS 

Listed below is a suggCHted timutahJo for admin- 
istering both the testH aiid the quuistionnaire at a 
Kingle .seH,sion. Kven though yiju admini.^ter the tests 
and the quuHtionnaire on two f(jnseruti%'e davH, you 
Hhciulri find ttiis Heliedule helpful Note that when 
h(;th teHtj^ and C|Uc^Htionnaire are adminiHtered in a 
single session, it is advisable tti give the tents first: 
but if two separate sessions are necessary, the qiies- 
tionnaire slunild l>e administc*red in tlu^ first sessicni. 

9A)i} a.m. Distribute test materials. 

9:10 a.m. liead instructions (or Voeahulary Test. 

9:11 a.ni. Begin Voeabulars Te.st. 

9:16 a.m. F^eafi liistruetions for Pielure-N umber 
Test. 

9:lH a.m. Begin Pieture-Number Test. 

9:28 a.m. Hend instruetions for Heading Te«5t. 

9;3() a.m. Begin Reading Test. 

9:45 a.m. Begin five-minute re.st break. 

9:50 a.m. Hoassemble istudonts. Head inHtruution.s 
for Letter Group.s Tg^X. 

9:54 a.m. Begin Letter firoup.s Te.st. 

10:09 a.m. Head instructicms for Mathematics 
Test. 

10,13 a.m. Begin Mathematics Te^t. 

10:28 a.m. Read instructions for Mo.saic 
Comparisons Test. 

10:31 a*m. Begin Mosaic Comr)ari.sons Te^t. 

10:40 a.m. Stop testing. Collec t ntmwer sheets and 
test books. 

10:45 a.m. Begin lOrminute rest break. 

10:55 a.m. Reasaemble students. Distribute 
Student Questionnaires. 

11:00 12;W Btudents complete queBtionnaires, ^al 
them in envelof^Si and turn them in. 
(There is no need, for survey purposes, 
for a student to remain after he has 
completed and turned in his question- 
naire j 
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ADMINISTRATOR'S SCHfDULE OF TASKS 

This section of tl.e Manual i. do.i«.u>d to h.lp you keep track <.f the task, you J'"^^/" ^^j^ "j;^^" ^^£n 
your sehool-H part in tlie National l.ongiludinul Study. Ta.ks that are not Heir=c,.'planatory have beer. 



Check 
when 

cnmplcUm NLS Dcadllni* 

Upcjii appijint rnunt 



Task 

L Confinn lluit the following have beon cnmpiled and sent to 
KTH via thu PrinciparH Ui'ply Ah in: 

List of ymir st'hool'H Htudent^ in grado 12 or equiviilent 
h. Lint of HtafT menilK>r8 who purfbrm twelfth-grade counHoU 
ing functions part- or fulUtime 

PreiVrred date and niakeup date for data collection 



Upon ajjjjointnient 



Head the O^lder National Lnngitudinal Study of thr liiRh 
School dass nf W7^ and the lenfiet Irifornmiion fur Srhool 
Admintstraturs. Review all other materfalH. 



U|>on apptjiiUniiMil 

1 1 pon' receipt of 
HampU' HoHter 



3. Review the Infonnalion Kit nent to your principah 

4 Invite hsted rounHelorH to take part iii the survey on the 
appointed date. DiHtribute invitations to studentH on the lint 
anci obtain their ngreement to partii ipate. 



I 'pon : et eipt of I lu' 
Hurvfv Adniini?-t ratorV 
( Nnitrni SlitM't 



^ Nciiifv tlu' priKon at vour Helunil who UHually reeoives 
parka^e. tn expeet the si.H KhipnicMit and to niform you 
wlien it arrives. 



I .1 the .hipnu-nt (Muu k the shipment. If your Khipmenl ^l^^f^""^^^^^^ 

' ■ tTS tiiUiHt inoneiliaiely. Complete the Materials Receipt 

Ai'konwU'dMinent poHteard and return it to KTH. Store the 
ninti'rial^ witii care. 



As j-iMJii ^is pnHsihje 



7. ArraiiMe iuv a n.oin fnr tlu* MdniiniHtrat ion of the queMtion- 
liaire and ti'Hl^ 



I ' jfoii riM t'lpt nt 
Hainple Hi»H|er 



H With a^^MMaiu i- as needcu! fn nn srhonf (jftii e Htain . omplel<r 
i, SluiiiMii's Si linnl Riunrd Inlbrmatlon forni lor . eaeh 
HtuchMU insited in pa^tieipMtc^ 



A-- t^non as posHihle. hut nnt 
liit-r 1 iian spin ilii^d 
rnaki'up date 



\K (Snopiet* theSi iin.,1 (Hu-stionnaire with aHHistam<^ an needed 
trnni prineijjal iir st liuol oMtee Klall, 



HcH'ord the- nuinher and name <)f eat h student participant (Ui 
a Student (Questionnaire, envelope, atiswer sheet, and Htu- 
(UmiIV MuhA Heinnl Inlnnnallon form. Hec^cird llu' identi= 
fyinii ini'orniation Ibr each counsehir parlieipant^ im. a 
Counselor (^leHtinnnairi^ and envelope. 
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As soon as i«iHHiblt' 

On H|it»iMfit'tl cialu 

On Hpurified niakfup tiatf 



rouurcU'ci tin* apiiroprintu idt'ntifii*ntiin\ » tti participatinM 
CiiiniKi'lnrH iMui MKk tlioin in Muni Ww ciut^Ht ioniiairuH iu you 
within Hin^t' diiVK, . ' ; —...-^ 

12. A(lniiniHl«-r tlii- HtiuiiMit Ciut'Hlinnnnin'. 

13. ir niu-cssiiry, MciininiHtc'r thc« HtucU'nl (^u'Htinnnnin' tn ntu- 
dents whn dill nni alltMHl tluM'Mrlii'r cjUi'Mt iiMinniri' K'Hsu>n. 



On Hpocifiud dntf 

On Hpccinud makuup dale 



14. C.ivi' tlu' tfsts. 

15, IC lUTi'Ssary, ^^ivu tin* tuntK tti HtudiMitH wlio did not :Ulund 
tlu' c^arlitM ti»Ht HrHMUih. 



AtlLTuach udmlniHtraticni IH. C^)mpU4u the iMnliltMn InrMdcMit HluM't. 



Prior to maiUng 



AfU'r makeup administration IH. 



mow poHHibiu but n«jl 
latur than fivu days aftur ihv 
makeup admiriiHt rat itni 



IH. 



.^oon m poHj^iblu but m)t 
later than five dayn after the 
makoup administration 

After miikcup adminiHtration 

When contacted 

1 r requuHtt'd 



When notified by Kl'H.tbnt 
your data coilut tinii ban 
been eomiilctcd 



20, 



Clieck ail cnniplctcd Htudcnt^N Hclujol Rtv«)rd Inlbrmation 
tbrniH. 

('(impU'tc thi* SampU" HosttT form. Draw a Hue thniugli the 
nanies of tliuHi' counMi*lors and students win? (Hd not par- 
ticipate. 

Plate tlu* IbllowinK in the carton pn»vided hir return of 
niatcriMls to KPH: 

Scaled unvelopes cuntaininM (lounHclor Quc^Mtionnaires. 
Healed envelopuH containing Ktudent (iucHtionnaires 
Answer Hiieet Kiivelope contahiing test annwur HheetK 
: Htudent'H Hchool He(u>rd Information ninns 
Hciiool QuuHtinnnaire 
One copy of Kample UoHter 
problem Incident Hheet 

Defective test bookn ahd teiit books containing auHwers to 
test questions (if any) 

Mail the carton. C!omplete the NotificHtioi vp<)stcard and 
mail' it to ets. 



2L Dentroy the tent booklets. 

22. Assist KTs in fbllowing up missing data. 

2;j. Arrange for a project stair member to visit tlic school at a 
mutually convenient time tn Aiiril or May, 

21. Destroy all remahiiiig survey niaterialH. 
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O M B No 51-S*7200B : 
APPROVAL EXPIRES 1t3!^73:. 



NATIONAL LONGITUDINAL STUDY JF THE HIGH SCHOOL CLASS OF 1972 



PROBLiM INCIDENT SHEIT 

iAlwayH include student iduniifiuation and test Hoction anbctudJ 



. *^ChOi-L NAME. 



SURVtY ADMiNr'STRAtOR S SiGNATURi 



7'ODAV S DATE 



DE FORM Plia M T72 



ERLC 



110 



APPEroiX c 
Test Analysis 
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Test ^alyil^ 

NATIONAL LONGITUDINAL STUDY OF THE HIGH SCHOOL CLMS OF 1972 

UEE ' 



March, 1973 
SR-73-29 



EDUCATIONAL TESTING SERVICE 

ptinemon. Nm Jtnt^—B*rk*lt^, Calif ornw 

ERIC - 



NATIONAL LONGITUDINAL STUDY Of THE HIGH SCHOOL CLASS OF 1972 

-UEE- " ' . ' 



\m u Frances Swine ford 

March, 1973 



Tha test battary, Fom UEE , that provides part of ^ ^t^^^ 
national longitudinal study of the educational and career progress of a carefully 
designed probability Sfflnple of 1972 high-Bchool ieniors was administered in the ; 
spring of 1972 to 15 , 863 students , 15,596 of whom became the final working sample 
for the study. The test outline is as follows i 

1* Vocabulary (5 minutes) 

2. Picture-Number 

Part 1. (study 3 minutes, teat 2 minutes) 
Part 2. (study 3 minutes , test 2 minutes) 

3. Reading (15 minutes) 

4. Latter Groups (15 minutes) 

5. Mathematics (15 minutes) * 

6. Mosaic .Comparisons 

Part 1* (3 minutes) 
Part 2. (3 minutes) 
Part 3, (3 minutes) 

Elavan scores were obtained for each student! a total score on each of - ^ 
Che rilx sections and the score on each part of Section 2 and Section- 6. ^ ; 



NOTES ON PRINCIPAL FINDINGS 

Total Group 

15,863 national sample of high^school seniors . 

Sample 

Sample of 1,955 cases slight ly more able than total group (but see text) 

Appropriateness of Test to Group . : , 

All distributions cover effective score: range. Letter Groups discriminates 

better at low end than at high end of score scale. : " 

Reliability : f ^ 

Estimates of ,784 for Vocabulary 845 for Picture-Number, .797 for Reading 
,861 for Latter Croups, .866 for Mathematics, and, probably, about ,90 for Mosaic ; 
Comparisons, ^ 
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Speededness — 

Vocabulary, Reading, and Kathama tics probably not unduly speeded. 
Evidence of some degree of speedsdnv ss in Letter Groups, Speededness not 
measurable for Picture-NiBnber. Mosaic Comparisons are speed tests,, as 
Intended. 

Mean Item Difficulty 

Mean deltas of 12^8 for Vocabulary, 12^ for Reading, 10*4 for Letter 
Groups, and 11,7 for Mathematics. Deltas considered not appropriate for use 
wlth-such tests as Picture-Niraber and Mosaic Comparisons. Middle^dif f iculty 
reference values are 12.0 for 5-'cholce items (Sections 1, 3, 4) and 11.7 for 
4-ch6ice items (Section 5). 

Mean^Blserial CorrelaCion 

Means of .63 for Vocabulary/ *58 for Reading^ .eS for Letter Groups, 
and ,61 for Mathematics. Criteria are corresponding total scores. 



TOTAL-GROUP STATISTICS 

Frequency distributions of nine scores that were obtained for the 
total group are presented on pages A to E. The part scores for Picture-Nianher 
are not included on these pages, since they were not among the reported scores* 
All the scores extend over a wide range, from less than zero to maximum possible 
values* If a test were of mlddia difficulty for this group (except for speed 
tests), the mean wouM approKimate one-4ialf of the nmnber of items. Vocabulary 
appears to be somewhat difficult | Letter Groups , quite easyi and Reading and 
Mathematics, near middle difficulty for the group, Picture-Nisnber and the 
Mosaic Comparisons tests are speed tests, whose difficulty can not be judged ' 
in the same way as that of power tests. 



SAMPLE STATISTICS 



A sytematic sample of 1,955 cases was drawn for detailed analysis. 
For this purpose no record was accepted if one or mote sections had been left 
blank for any reason . This restriction is more likely to eliminate low-^ablllty 



students than the able ones, and the analysis jample is indeed a little more able, 
on the average j than the rctal group J as Is apparent from the score data for the 
power tests, given below. Since the total-groyp scores were recorded to three 
decimai.piaces md Che iample scores were rounded to the nearest whole numbers, 
with those ending in .5 rounded to the neKt higher integer, a value of 0*125 has 
been added to the total-group means for Vocabulary, Reading, and Letter Groups in 
order to make them comparable with the sample means* 

Sample Total Group 

Mean S,D, Mean S*D* 

Vocabulary 6.28 4,22 6,14 4.16 

Reading * 9.71 5,15 9*45 5.12 

Letter Groups 16* 19 5,96 15,92 6*01 

Mathematics 12*53 7.47 12*25 7,43 

The mean differences for Reading. and Letter Groups are statistically 
significant at the 5 per cent level of confidence , but the actual differences are 
considered small from a practical point of view. 

Estimates of the reliability of most of the scores are given at the top 
of page F. Those for Vocabulary, *784^ Reading, ,797; Letter Groups, *861; and 
Mathematics, . 866, were computed by the Kuder-^Richardson formula (20) adapted for 
use with R-KV scores. IntBrnal estimates, such as those provided by the 
Kuder=Richardson procedures, are not appropriate for use with speed tests, Tlie 
best estimate of the reliability of each part of Picture-Number is the correlation 
between L hem » *726. The reliability of their sum was_computed by the fomula, 

er ror variance^ 
reliabiLity - 1 - cocar variance * 

where the error variance is the sum of the squared standard errors of measurement 
of Che 15-^item parts and the total variance is the variance of the 30-item total 
score. The resulting reliability estimate is .845. No attempt has hieh made to 
assess the reliabillcy of the three Mosaic Comparison tests, for they differ 
from one another with respect to both complexity of Items and number of items. 
Correlations betweiin any cwo may well underestimate the reliabiltty of either. 
The reliahtlicy of any one of thum is probab ly no lower than > 75 and possibly 
much higher. Thy reliability of their sum is probably about ,90, 



"4- 



Intercorrelations among all eleven scores are presented In the tniddle 
portion of page The six correlations Mnong the four power tests range fr^^ 
,496 between Vocabulary and Letter Groups to .686 between Vocabulary and Readings 
Hie correlations among the three parts of Mosaic Comparlions are 74 between 
Parts 2 and 3, •68 between Parts 1 and 2^ and .58 between Parts 1 and 3 ^ which 
are the most dissimilar pair. It is not possible to Judge the Picture-Nisnber test 
with respect to its power and speed characteristics. Its correlations with the 
power tests are .292 /Vocabulary ; *355, tending; .451 Le titer Groups ; and ,423, 
htetheraatics , and its correlations with the three parts of Mosaic Comparisons are 
,318, *J64V and .352, Thus* on the average, it is more highly correlated with the 
power scores than with the speed scoresj but the difference is eKtremely small. 

Data relating to speededness are given at the bottom of page F. IF 
at least. 80 per cent of the group reach the last Item and if virtually every 
one reaches at least three-quarters of the items, speed may be considered an 
unimportant element in the score. The data for Vocabulary , Reading, and Mathematics 
satisfy the first of these somewhat arbitrary criteria of an unspeeded cest, but 
none satisfies the second. There Is evidence of some speed In Letter Groups , since ' 
the last four items were reached by less than 80 per cent of the sample. The data 
for the Mosaic Comparison tests show all to be highly speeded, a/i intended. The 
Plcture-Nm^er tests present two difficulties i firsts it is not possible to 
evaluate the timing allotted to the study periods - md ^ secondly , it can not 
reasonably be assumed thar an examinee would record his responses in item=-nuinber 
order—on the contrary, it is perhaps more likely that^he would first pick out 
the items that he best remeniers and then go back to those about which he is less 
certain. For this reasoHp It has been decided not to report speed data for this 

test. ■ . ■ - ■ 

gp^Qi^l score data are presented on pages G to 0, which include frequency 
distributions of the; number of items answered right, answered wrong, omitted, and 
(except Picture-Nmnbar) not reached and two-way distributions of Score versus R+W. 
An unspeeded test would be expected to have a low NR mean and standard deviation 
md B high proportion of entries in the right-hand colimns of the two-way table, 
A speed test, on the other hand^ would have a high NR mean and standard devlaCion 
md a high proportion of entries along the main diagonal ©f the two-way table. 
Vocabulary, teading/ and Mathematics (pages G, J, and L, respectively) have the 

. ■■■■ 116 ■ ■ ■ 



erJc 



characteriatics of an ims paeded test* In the case of Letter Groups (page K) , the 
NR data are low enough to suggest that the test is not speeded, but the dropping 
out through the last five items ^ already noted, and the configuration of entries 
near the upper end of the principal diagonal strongly suggest that a substantial 
proportion of the group would have increased their scores If they had been given 



more time, 



The speed tests. Mosaic Comparison (pages N, and 0), clearly ■ ; 
exhibit the typicn speeds characteristics. Each NR mean eKceeds the Score 
mean, and each NR standard delation differs little from the Score standard 
deviation. The mean number of errors is only 0 . 87 for Part 1, 1. 11 for Part 2, 
and 1.36 for Part"3, the slight increase consistent with the increasing complexity 
of the item type, and the mean number of omissions is even loweri 0.25 
and 0.13. 

The configurations of entries in the two=way tables for the Picture^ 
Number tests (pages H and I) resemble the typical speed^test configuratio But 
in this case failure to respond may well be more a function of memory than a 
function of timing. The R distributions are quite; unlike the R distributions 
for Mosaic Comparisons. Each has its modal value at ISy the maximum possible 
score—a strong hint chat spec?d is not a prominent element . ^ 

If an answer sheet were marked at randum, the resulting score would most 
probably approximate-zeror and the c aru 99 out of 100 that it would lie 

below the dashed line drawn near, the bottom of the two-way table. Per cents of 
scores on the several tests that are within the chance area defined in this manner 
are more than 34 for Vocabulary, less than 5 fur each part of Picture-N umber, 
about 22 for^ Reading, 6 for Letter Groups, near 1 y 24 f or Ma thema t ics , and no more 
than 5 for any part of Mosai c Cumpar i Hons . The right-hand columns of the Mosaic 
Comparisons tables consistently contain scares fur a few individuals who succeeded 
in renching the end with a high degree of accuracy and a handful of individuals 
with scores within Che chance area: Onu wtmders whether tlie latter eKamlnees 
failed to underHtand the direccluns, or felt runstrained to roach the end without; 
duu regard for a ccuracy , or possib ly had sumo v i Bua 1 deficiancy that made the 
task particularly difficult for them. • 
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■ ■ ; V:NT^^ are sunmarized on page P* Ac the top of the page 

are £cequen-y distribuclons of the d delta. The numbers In the 

stub of the tabla indicate the range within which delta usually lies . The ; 
mlddle-^dif f iculty value (a useful reference point) varies somewhat with the 
nu^er of options per item. For a S-choice item, such as those of Sections 1, ^ 
3, and 4, It is about 12.0, and for a 4-choice item (Section 5) , it is 11,7. 
Not only is the Vocabulary mean delta as much as 0,8 higher (harder) than middle 
difficMlty but also only three items are easier than this reference value, a 
flndiug that explains the large proporticn 'of Vocabulary scores that are within 
the chance area, , 

The Picture-Number test can best be considered as a unit ; that is , a 
group of high-school seniors can in two minutes, recall with better than 50 per 
-cent-accuracy^ a^ set^of^ l5^such_iteras.-imM . 
Yqx this reason Inforaation about individual items has not been included. 

The mean deltas of 12.1 for Reading and 11*7 for Mathematics show 
both tests to be of middle difficulty for this group. The very easy Letter Group 
test has a mean delta of 10.4, which is 1*6 delta points below the middle-difficulty 
reference value* - 

Each part of Mosaic Comparisons is a speed test in the sense that 
'almost every item answered was answered correctly, and few items were omitted. 
Consequently, item statistics are not reported for these tests. 

At the bottom of page P are distributions of the biserial correlations 
of item scores with criterion scores. The criterion for the Items in a colisTin 
is the score on the section indicated at the head of that colvcnn. As one might 
expect when the group consists of a grade at high-school level, without selection 
on any basis, these correlations are high* Mean values range from ,58 for Reading 
to -65 for Letter Groups/ Few coeffiGlents are in the .40'Ss and only two are in 
the 30-s. It should also be noted that there may be a noticeable spurious effect 
on the correlations for Sections 1 and 3, because each Item is a substantial part 
of its own criterion. When there are 25 or more items in a criterion , the 
spurious effect in the correlation between one of the items and the total is 
relatively small and may be ignored for practical purposes. 
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TEST ANALYSIS REPORT FORM 

Test Nat Lunal Longitudinal Scudy Subject Forni UEE_ 

Taken by Grade 12 studencs , Date Spring 1972 

. . Project _825_ Job _J0_ 



. \ Vocabulary 


P i c t ure umbe r 


^ Raw 
Score 
X 


Standard 
Score 
Y 


f 


Percentile 

nank ol 
Lower Limil 
of Interval 


Raw 
Score 
X 

A 


Standafd 
Score 
Y 


f 


Percentile 

Hank ol 
Lower Liniit 
of Interval - 




1 K 




1 / ^ 




97.6 


30 






953 




94,0 




14 




575 




94.2 


28 


- 29 




1156 




86,7 




13 




720 




89,7 


26 


- 27 




973 




80,6 




12 




208 




88.4 


24 


^ 25 




920 




74,8 




11 




786 




83 , 4 


22 


23 




1068 




68.0 




10 




932 




— — 77r5— 




- 21 




114 3 




60 . 8 




9 




1208 




69.9 


18 


19 




1166 




53.5 




8 




1318 




5 1 .6 


16 


" 17 




: 1312 




43.2 




7 




622 




57. 7 


14 


15 




1260 




37. 3 




6 




1414 




48.8 


12 


- 13 




1301 




29.1 




5 




1544 




39.0 


10 


- 11 




1201 




21.5 




4 




1597 




29.0 


8 


- 9 




1052 




14.9 




3 

2 




1550 
639 




19.2 
15.2 


6 
4 


- 7 

- 5 




886 
681 




9.3 

5.0 




1 




1046 




8.6 


2 


3 




492 




1.9 




0 




772 




3.7 


Q 






250 




0.3 




1 




385 




I.J 




^ 1 




47 




0.01- 




-2 




176 




0.2 


^ 4 


- - 1 




2 




0.00 








29 




0.0 
























- I 








15863 






























'-. - 




1586 3 


















% 


^ 6.02 


Conversion 


Data 


M ^ 


16, 76 


Conversion 


Data - ^ ; . 












X 












o . 


;^ _ 4 , 16 


No conversion. 






0 = 


8. 13 


No conversion. 






X 










X 












M 










M - 












V 










y 


































Md 


^ 5,64 








y 


16.64 




















X 












■ (15 


.Items) 








(30 iceins) 
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TEST ANALYSIS REPORT FORM 

Test National Longitudinal Study Subject 

Taken by Grade 12 studjnts ' „ 



Form UEE 



Date Spring 1972 



Project 825 Job 50 



Reading 



Raw 

Score 
X 



20 
19 
18 
17 
16 
15 



14 
13 
12 
11 
10 
9 
8 
7 
6 
5 
4 
3 
2 
1 
0 

- 1 

- 2 

- 3 

- 4 

- 5 



M 



s 9.32 



= 5.12 



M = 



0 = 



Md - 9.88 



(20 iceras) 



Stanch rd 
Score 
Y 



'eroentile 
Rank of 
Lower Limit 
of Interval 



117 
312 
572 
88 
740 
1071 
1166 
1275 
318 
1167 
1275 
1206 
1179 
401 
994 
957 
802 
705 
260 
504 
395 
209 
107 
19 
18 
6 

15863 



99.3 
97.3 
93.7 
93.1 
88.5 



81. 
"74, 
66, 
64, 
57, 
48, 
41, 
33. 
31, 
25, 
19. 



14,0 
9.6 
7.9 
4.8 
2.3 
0.9 
0.3 
0.2 
0.04 
0.00 



Conversign Data 
No conversion. 
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Letter Groups 



Raw 
Score 
X 



24 




25 


22 




23 


20 




21 


18 




19 


16 




17 


14 




15 


12" 




1 3 


10 




11 


8 




9 


6 




7 


4 




5 


2 




3 


0 




1 


2 




- 1 


■ 4 




- 3 


■ 6 




- 5 



M ■= 15.79 



= 6,01 



M = 



yfci >» 17.13 



(25 iceras). 



Standard 

Score 
Y 



Psrce.ntil e 
Rank of 
Lower Limit, 
of Interval 



981 
1792 
2547 
2448 
1709 
1592 
1162 
1075 
. 901 
493 
526 
246 
243 
121 
19 
8 

15863 



93.8 
82.5 
66.5 
51.0 
40 
30 
22 
16 
10 

7 

4 

2 



0.9 
0.2 
0.1 
0.0 



Conversion Data 



No conversion. 
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TEST ANALYSIS REPORT FORM 

iQst National Longitudinal Study Subject 

Taken by Grade 12 students — , 



- Form _UEE_ 

nat-B Spring 1972 



Project 825 job 



50 



Raw 
Score 

X 



24 




25 


22 




23 


20 




21 


18 




19 


16 




17 


14 




15 


12 




13 


10 




11 


8 




9 


6 




7 






5 


2 




3 


0 




1 


_ 2 




- I 


- 4 




- 3 


- 6 




- 5 



7 .4 3 

X — - . 



M « 

V 



J<di:_^ 12,37 



Mathematlca 



Standard 
Score 
Y 



Percentile 

Rank of 
Lower Limit 
of Interva] 



1168 
809 

1631 
920 

1609 
949 

1616 

1022 

1582 
982 

1422 
812 
875 
318 
139 
9 

15863 



92 
87 
77 
71 
61 
55 



6 

.5 
,3 
,5 
,3 
.3 



45.1 



38. 

28, 

22. 

13, 
8, 
2, 



0.9 
0.1 
0.0 



Conversion Data 
No conversion. 
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Mosaic Comparisons , Part 1 



Raw 
Score 
X 



56 

52 - 
A8 - 
44 - 
40 - 

36 - 
32 ' 
28 - 
24 - 
20 - 
16 - 
12 - 
8 - 
4 - 
0 - 

- 4 - 

- 8 - 
-12 - 



55 
51 
47 
43 
39 
35 
31 
27 
23 
19 
15 
11 
7 
3 

- 1 
-5 

- 9 



M = 19.93 



M 



o =• 



8 


.43 






19 


.80 



(56 items) 



Standard 

Seore 
Y 



15863 



ercentile 

Rank of 
kywar Lindt 
of Intarval^ 



91 


99.4 


93 


98.8 


35 


98,6 


69 


98.2 


121 


97.4 


244 


95.9 


400 


93,4 


957 


87.3 


2508 


71.5 


3698 


48.2 


35 75 


25.7 


2352 


10.8 


935 


4.9 


366 


2.6 


287 ' 


0.8 


106 


0,2 


25 


0.01 


1 


O.OO 



Converaion Data 
No conversion. 



mST ANALYSIS REPORT FO^ 



Test National Longitudinal Study 
Taken by Grade 12 students 



Subjaet ^ 



___ Data Spring 1972 
Project 825 job - 



Mosaic Coinr arlsons , Part 2 



Raw 

Score 
X 



32 




33 


30 




31 








■ 26 




27 


24 




25 


22 




23 


20 




21 


18 




19 


16 




17 


14 




15 


12 




13 


10 




11 


8 




9 


6 




7 


4 




5 


2 




3 


0 




1 


- 2 




« 1 


- 4 




- 3 


- 6 




- 5 


- 8 




- 7 



M = 14.50 



s= 5.76 



v,v (33" Items) 

iERicS^i 



Standard 
Score 
Y 



I'ercantile 
Rank of 
Lower Limit 
of Interval 



140 
53 
93 
159 
341 
632 
980 
1801 
2849 
2 771 
2052 
1515 
945 
547 
264 
172 
368 
109 
63 
6 
3 

15863 



99.1 
98.8 
98. 
97, 
95, 
91. 



84.9 



73 

55 
38 
25 
15 
9 
6 



5 
6 
1 
2 
6 
7 
2 
4.5 
3.5 
1.1 
0.5 
6.1 
0.02 
0.00 



Mosaic Comparisons, Part 3 



Conversion Data 



No conversion. 



Raw 
Score 
X 



2{i - 
24 - 
22 -• 
20 - 
18 - 
16 - 
14 - 
12 - 
10 - 
8 - 
6 - 
4 - 
2 - 
0 - 
-2 - 

- 4 - 

- 6 - 

- 8 - 



27 
25 
23 
21 
19 
17 
15 
13 
11 
,9 
7 



H ^10.59 



122 



H = 



4. 


84 






10. 


41 



(27 Items) 



Standard 

Score 
Y 



^srcenti Lc- 
Rank of 





of Intervaj. 


120 


99.2 


52 


98.9 


111 


98.2 


J ^ 


96.6 


b 74 


92.-4 ■ 


1018 


85.9 


1975 


73.5 


2495 


57.8 


2664 


41.0 


2919 


22.6 


1610 


12.4 


954 


6.4 


402 


3.9 


465 


0.9 


118 


0.2 


29 


0.02 


2 


0.01 


1 


0.00 


15863 





Conversion Data 
No conversion 



mST AMLYSIS raiPORT ¥om 
Test National Long itudinal Study Subject . 
Taken by Grade 12 students 



Form 



UEE 



Date Spring 1972 

Prnject 825 jol 



Mosaic Comparisons, Total 



Raw 

Score 
X 



114 




116 


108 




114 


102 




108 


96 




102 


90 




96 


84 




90 


78 




84 


72 




78 


66 




72 


60 




66 


54 




60 


48 




54 


42 




48 


36 




42 


30 




36 


24 




30 


- IS 




24 






1 9 


6 




12 


0 




h 


= 6 




- 0 


^ 12 




- 6 


- 18 




- ,12 


- 24 




- 18 



/45.01 



16.43 



y 



Md - 45.10 



(^16 Items) 



Standard 
Score 
Y 



"Percentile 
tonk of 
Lower Lifliit 
of Interval 



15863 



*4 J 


Q9 7 






m 




£. t 




36 


98,9 


79 


98.4 


145 


97,5 


281 


95.7 


593 


92,0 


1112 


85.0 


1842 


73.4 


2579 


57.1 


2824 


39.3 


2361 


24,4 . 


1658 


14*0 


956 


8,0 


...._528" 


„_„.^^4.6^ 


252 


3.0 


152 


2,1 


206 


0.8 


93 


0.2 


24 


0.1 


7 


0.01 


1 


0.00 







Conversion Data 
No conversion. 



Raw 
Score 
X 



Standard 

Score 
Y 



M - 



a - 



M « 



0 — 



123 



Percentile 

Rank of 
Lower Lindt 
of Interval 



Conversion Data 



Naticr.a; Loii^\' .idlnal Study 

Spaced sainple 



-F- 

_ Sub^^c'ct _____ __ 



Form 



UKIi 



Scoring Formulfla and Reliability Coefficients for Sertlgas. 



Sec tier, of Test 



,'oca3Ui.ary 



Total 



Scoring 
Formula 



R-W/4 



R-. IIIW 



R-.lllW 



R-.lllW 



R-.W/4 



Rella-, 
blllcy 



784 



726^ 



726** 



845** 



797 



SE 



meas . 



1.96 



2.28 



2.14 



3.13 



2. 32 



S.'. '-lon of Test 



4 LaJ,zAT Groups 



5 Machemaclcs 



6 Mosul c Compar, 



1 



3 Reading 

*Adapcat lon of Kuder-Richardson formula (20). * *Saa text. 

Tn^prl^nr^elatl ons fjf Sections 



Scoring 
Formuln 



R-W/4 



R-. 333W 



R-U/2 



R-.333W 



R-W/4 



Rell a-^ 
billty 



,861 



,866 



meafi 



,23 



2.73 



Sacr ion 



1 Vocabulary 



Pic. -Num. 



.284 



;254^ 



Total 



.292 



j86 



4 LetCe'r Groups 



5 Matheir..i'-lcs 



6 Mosaic; 



,496 



.610 



.210 



,276 



283 



■oral 



.282 



2-1 



,234 



,726 



.933 



i-2 



,:54 



,726 



.924 



,29? 



,933 



,J24^ 



331 



.448 



,4i5 



305 



354 



.338 



372 



300 



387 



368 



.284 



,321 



.314 



343 



355 



,686 



351 



.-.300 



355 



,451 



.423 



318 



,364 



352 



.386 



,595 



.667 



.274 



.342 



342 



354 



,496 



.448 



.381. 



451 



595 



.674 



387 



.488 



,460 



.494 



,1Q 



,413 



,368 



,423 



,667 



.674 



326 



388 



,389 



409 



6-1 



,210 



,305 



,284 



318 



,274 



387 



326 



.683 



,579 



,900 



6-2 



,276 



354 



321 



364 



342 



,488 



388 



,683 



739 



,900 



6-3 



.283 



338 



,314 



352 



.342 



,460 



389 



,579 



739 



,833 



.282 



372 



,343 



386 



.354 



,494 




.900 



,833 



SpeededneBd of SecCions 





1 


2-1 


2-2 


3 


4 


5 


6-1 


6-2 


6-3 






S".';. : tun 

I'ljr cent com- 


82.3 






81.8 


57.6 


85.0 


1.3 


1.7 


2.0 






pleting test.. 
Per cent com- 
plkiting 75 per 


94. 7 






95.9 


94.7 


96.3 


2.5 


6.2 


6,1 






dsnt of test • 
NtEfibttr of items 
reached by 80 
per cent of 
t»>* candidates 


15 






20 


21 


25 


15 


12 


9 






Total number of 


15 


15 


15 


20 


25 


25 


56 


33 


27 







ERIC 



121 



lEv National Longiiudinal Study 
yc iiy* 1 



Vocabulary 
IS tS=(ioici) 



V:. UE£ 



N . ID- \V n 131 1^ 151 



scow 




4- 5 




R 



13 
14 
13 
11 

a 

10 
9 
B 
7 
6 
I 

3 



5^ 
14 
78 
12 

117 
110 

160 
193 
198 

m 

190 
IBO 
U5 
74 
45 



15 3 

Hi 10 

I 

13 
12 



U 

10 



29 
55 

10 
137 
91139 

el ISO 



3 



179 
193 
100 
19 
192 
153 
116 
ID 



0^ 



11 I 

10 

9i 4 
8 



13 
18 
37 

47 
83 
B7 
163 
216 

olias 



N R 



lifrH 



itlonal Lodiltuilnal Study 



FORM Ulg 



15 (IQ-chQlce) 

, Part 1 ' - / 

















1 

i 


2 


i 

fQ 


fQ 


5 

to 




7 

TO 


8 

10 


ro 


IQ 


llj 

TO . 


12| 13 


14 


TQ 


to 








R 


w 


0 

(QMtT) 


{NOT REfiC 








o 


f 


ittmi 


f 


Nymrff 


f 








f 






























— « 




229 


15 
14 
13 
12 
11 

10 

§ 

8 

7 
6 
1 
4 
3 
1 
1 


229 
120 
118 
116 

77 
133 
123 
111 
160 
14^ 
141 
155 

99 
ICQ 

56 

Z4 


10 

f 
e 

7 
6 

S 

3 
2 
1 


I 

11 

in 

67 

10^ 

aio 

5lfl 
1005 


14 
13 
12 
11 
10 
9 

8 
7 

t} 

4 

i 

7 

L 


7 

23 
75 
121 
151 
160 
172 
117 
149 

105 
112 
126 
123 
288 














r 














79 


4 i 






120 
















1 








f 5 


29 


13 






Hi 








— — 
















f ' 


11 


\C3 


4 






116 






















44 


21 


A 


4 






77 




















81 


39 


10 


1 










133 


















62 


47 


4 


h 


3 










122 
















7« 


■ 46 


13 


9 


I 




1 








146 














71 


57 


15 


5 


3 




3 




1 






161 

^145 












63 


42 


24 




5 




1 


1 


















^6 


20 


9 


T 




4 


I 


1 










147 




t 


43 


55 


29 


11 


9 




1 


1 












149 




i 




23 




2C 


8 


12 




5 


I 

^1 


I 


1 












9S 




I! 


j 2fi 


16 


LO 








^2 


1 










99 

59 




^ 6 




" it 


1 




i ^ 




\ I 














! 




3 




' ^ 




] 




1 


1 
















II 
2 


j ! 


i ' t 


1 


1 








! 






7| 23 


7S 


4^ - - 
121 


151 


I6C 


172 




^ W 




105 


UI 


ill 


N 12i 


\ 2BI 


i 




1955 


1955 


1955 


1^55 






i 




















y«3S 


S.41 


0*93 


\M 




2. Picture-Number, Pare 1 


4,35 


4.31 


li34 


3,84 





. . - - ■ . : .128: 



ERIC 



.u^M IIEE. 




■'I r\mu4mMt; Fan 



130. 



TEST Nltlonil Lon|lEudinil Study 



»Qpv DIE 



9 t ft ! 



.5 6i tI 




10 11 


n 


13 


14 


15 


i 


TO S f: 










'5 



16 



n 

tu 



IS 



19 



17- 18 



15- Iffl 



4—1- 



4- 




II 2 





1 - — , - - n , =1 

10' • 1 

! i i 






7- 


1 1 1 4— 


1.-- -i 





I: 4^ ^1 



H H 

3! . 7! 1 



11 



7 



5- 6: 



— 
i- > 




' 11 I! 5i ^: 6^ 4 



-I' 0 
-3' -2 



'1 



11 i 



I 5 



I; 4! 2J 



7| U 



4! -5 



i, 64 



11 



12 



10 



20 



35 



2ii 



241 



121! 



2361 



Hi 17^_ 



mm 



66 



91 



240 



197 
176 



6 



12| i3i m 



It 5 



331 



1 I 



I ■ ; 1 


3 


a 121 4 J 




4 


nrnr 



316 
162 
253 

SI 

12 



R 

iRIGHTi 



11- 19 
16- 17 

I't- 15 

12- 13 



U 
137 
144 

300 
312 



10- 111297 



iV 



NumBsf ijf 



f 



20 

11- 19 

16-17 49 
14- 15 120 

12- I3i luil 
10- U{ 261 



0 

lUMlTj 



j|fmi 



I 



6| 3 



13; 33 2 J £d 42: 



77! 1661447; , \'m 



3. leadlni 



i.71 



5.15 



6- 7 202 

4- 5 135 

3! 37 
0- l! 6 



1955 



11.50 



4.22 



6- 7 349 

i 

4- ! 
2- 3 247 

0- 1 n 



1955 



7,67 
3,99 



61 I 

i 

5j S 

4! 7 

3i 20 

2 38 

I 159 
01720 



itemi 



1955 



0.20 



0.66 




•2* -1' 





■J . 










...Tsrsi., 


i' 




I 


■i| u 







.. , 4. Letter Groups 



;eric133 



SatiQnil Loniitudlnal Study 



^..4 UEE 




5, JiaEheniacic 



■ Sational Longitudinal Study 

^itist"! 6, Part 1 



byh;[L-: . MoSiie Coniparisoni 



UEE 




\ " ■ 6, MoFiic Conipiriifins, Part 1 



■iuT . : Nitlonil Lgngitudlnil Study 



Moiale Coipaflioni 
iriMi . 33 (4*shoici) 




. 6,. Hosai& CoiDpariaoni, Htt I 



"jj!,! National Lingitudind Bludy 



' bicnnN L Part 3 



.,up,i: ■ Hosiic Cpapariioni 
2? (5-ehoici) : . 



m 




ill).- 'H'tiSJC/i 

■ - ■ 6. -Mosaic Goipirisons, PirtJ 



rERiC 141 



14 



Tasi JJatlonal Longitudinal Study 



Suhjeet 



Form 



UEE 



+ 



t 



n 



Prequancy DiBtrlbutionB Of Original Deltas 
and BiBerialCoprelations, by Sections 



Section 



Delta 


I 




3 




4 




5 








19.0 UD . . 






















18.0*18.9 






















17.0-17*9 






















16.0-16.9 






. X 




1 












15.0-15.9 


1 




















14.0-14*9 






2 




1 




1 








13.0-13.9 


•a 




5 








4 








12.0-12.9 


4 








2 




9 








11.0-11.9 






1 




6 




2 








10.0-10.9 


1 
1 




3 




5 




6 








9.0- 9.9 




3 




3 




3 








8.0- 8.9 


1 




1 




2 












7.0-7.9 






















6 0- 6 9 










1 












Total . ... 


15 




20 




25 




25 








Ms an . # . . 


12,8 




12a 




10.4 




11.7 








^ ..«••.«• 


2.0 




2.0 




2,1 




1,4 








a .......p 






















^ ..#.«*. • 























ERIC 







.90-, 99 






















.80-. 89 






















.70-79 


5 








9 




5 








.60-. 69 


6 




9 




9 




11 








.50-. 59 


2 




3 




6 




7 








.40-. 49 


1 




2 




1 




1 








.30-. 39 


1 












1 








.20-. 29 






















.10-. 19 






















.00-. 09 






















Negative , 






















Total . , . . 


15 




20 




25 




25 








Not Cofflp. 






















Kun . • . • I 


.63 




.58 




.65 




.61 








^ #•*••*** 


.10 




.07 




.08 




.09 




- 





I 

-J- 



APPENDIX D 
Item P-Values 



"o ^-.■ 



llfcM 

.rv-i- 
\" I 
Hi 

1- !j 

■ r 6 
h ? 

i - •? 

kil 
1=12 

1-15 



.315 *i30 

.674 i63l 
.412 .408 
*i54 : ijT4 
.264 .189 
.326 .244 
.331 ,246 

\m .162 
.157 

.287 .216 

*27Q: .20? 
,26* .158 



ITEM P-VALUES by G 

HA PR 01 OR : WE .HC ''5 

.551 .595 . 579 .790 ,. 636 . - .^^ '^^ 

::,20 .582: .617 ; .670 :.759..^» ..^ 

,H5 .^68 .505 .523; .599. .^^^ 

.30i .266 ^327 .57V .666 . « : .6 

ay .139^.243 .392 . :.«0: .M3^ 

m 215 .364 .403 .510 .*78; .441 .530 

: • r :2;^ .438 .514 : .^^^ 

: . 076 .178 .375 .. 435^.^ 

.147 .139 .1« -Sll '"^f^ 

.249 . 228 . 355 . 341 .350 : . 317 . 322 ; . 336 

.257 .190 .346 .273 .378 .299 - .314 

,216 . 24L -327 .392, ..506 .401 .395;,,. »^ 



HE4N S.Pi 



.829 .084 : 

,460 .12§ 

,675 .129^.; 
,16911134 : 

,739 *119 

.514 iQ61^^ 

,458 .149 : 

,299 .099 ; 

,312 .103 

,376 .^13^ 

.272 .116 
,238 : . 092;; 

,300 .050; 

.335 ilOT: 



HUN 
S.O. 



iiq 121 344 .342 .410 .514 .M^ 



145 



146 



ERIC 



TABLE D-2 
ITEM P-VALUES BY GROUP 
PICTURE-NUHSER 















■ ■■ \ : 










■ .1 ■■llit^-ii.-i. 






A A 


HA ' 


PR 


Hi 


OR 


.; J?' '■ ■ 

HE 


mm IB « !n 


W3 




HEAN- 


S.D. 


m 1 

h I 


.596 


E A ^ 

»593 


i651 


c fi e 


■ 589 


•69j 


711 

•711 


a7a 
• 6(0 


AQ7 

• 69 f 


AAA 

• 664 


•646 


.046 


f '1 


/fir 

.681 


• 592 


/a □ 


•671 


• rOl 


77fl 
• Y f 0 


f aA 

i/a9 


• f f4 


77fl 


• r3U 


.719 


.059 


I' 3 


*758 




•769 


.739 


7 E7 


• 773 


D AQ 


7ai 

• 792 


Q A4 


7Qn 


•769 


.032 


I- 4 


.607 


.523 


i ^5 "1 

• 633 


• 570 


•617 


Lit 

•642 


• f03 


A fi A 

• 694 


A Q 7 

«o9f 


471 


.636 


.056 " 


f F 

; I" 5 


• 360 


.320 


•427 


#266 


f43y 


AAA 


A74 


A7A 

• 4/6 


E A A 


•4J£ 


.416 


.073 


1-6 


■399 


.327 


•408 


T ft/ 
• 304 


37/ 

.374 


A fl t 

•483 


A7A 

#476 


A7A 

• 4f0 


AS5 
• 404 


A 47 
• 444 


.416 


.062 


I- 7 




Eli 

• 316 


• 629 


EC 7 


• 564 


A as 


^ AA 

# /4y 


7 id 
• f 1? 


7^4 


Adq 
• 673 


.655 


.072 


I- 8 


.506 


.420 


e ^ ^ 

.557 


#430 


• 523 


AEQ 

• 659 


AAA 


AAA 
• IU4 


A 0 7 

•622 


• 37U 


.551 


.076 


I" 9 


.472 


.344 


i445 


• 392 


•336 


•517 


£ AA 

•506 


El A 

• 530 


£7 7 

•522 


Ell 

• 311 


.458 


.071 


I-IU 


.416 


•329 


♦422 


•329 


• 336 


•483 


£ 7 A 

.520 


• 512 


• 525 


•463 


•434 


•075 


I-ll 


.449 


.338 


•422 


•354 


•458 


£ ft ft 

• 580 


• 331 


E7 E 

#535 


E 7 □ 

«32o 


AQ7 


•471 


.071 


1-12 


^ ft T 

• 362 


.276 


i e 7 

•357 


•291 


• 333 


• 433 


A 3 A 

.494 


A Q 1 

•481 


ASK 

e4B3 


447 
• 774 


,401 


.076 


M3 


*483 


•328 


•431 


.342 


•449 


tea 

•659 


£ ft 3 

•608 


EAA 

• 396 


£ 7 A 

•3f4 


EKQ 

• 337 


.503 


.108 ' 


1-14" 


- .416 


.353 


•427 


• 392 


•430 


.619 


.575 


£ £7 

.557 


C / A 

: .549 


E 7 7 

• 522 


.484 


.086 


1-15 


• 326 


.255 


.355 


.241 


• 363 


• 551 


•502 


• 514 


•495- 


i 7A 

•4/6 


•410 


.107 


1-16 


.697 


.670 


•659 


• 696 


.692 


.778 


7 / / 

•746 


7i i 

#741 


7i A 

•759 


7 7A ■ 

• 720 


.716 


,•037 


1-17 


•60? 


•491 


.567 


•468 


• b70 


i ft Q - 

•603 


i 7 ^ 

•673 


i / A 

•640 


LLC 

•665 


£ 1 A 

•619 


.591 


•065 


1-18 


• 882 


•819 


iS51 


• 686 


• 869 : 


Li 3 i 

• 686 


AA 1 

•901 


■■■■■'a 7 5' ■ 

• Si3 


■ 0 S 7 

• oo3 


07/ 

io/4 


•872 


.022 


1-19 


.489 


•488 


.512 


•443 


^ ft i 

.486 


Lit \ 

#631 


^ 1 A 

• 614 


• 596 


A 1 7 

•617 


E77 

•573 


•545 


.065 


1-20 


• §51 


.458 


CAT 

•502 


• 354 


/ E Q 

•458 


i33i 


e7A 
• 3f U 


i / A 

• 544 


• 303 


«322 


•510 


.066 


1-21 ■ 


• 545 


•515 


E fl J 


• 481 


• 33l 


ae^ 


4AA 

• q4U 


• 666 


4^4 


4AQ 


.590 


.061 


1-22 


#590 


U 1 1 


• 531 


« 436 


• 3 f 7 


• PlQ 


463e 


447 


441 


■ #QU? 


.594 


.068 


1^23 


CI "J 

#31/ 






• 4"1 


• 76f 


• 074 


• 3 r 3 


• 377 


• Ov3 


• f 


.514 


.100 


t i/ 






t5?3 


• 33* 


• QW 1 


71Q 


t r 3? 


■ 1 40 ~- 


6 f A ? 


# f W 4 


•666 


.071 


i-2i 




• £^9 


ii2* 


• 163 


• ill 


• 339 


• 3qU 


?71 
f 3 f 3 


• J7 J 




.319 


.067 


1-26 


• 534 


AAA 

•40y 


•531 


• 43U 


• 333 


• QUO 


An7 
ioUf 


41 A 
• QlU 


4flQ 
• QV7 


• oyi 


•546 


.073 


1-27 


.433 


.319 . 


• 4uZ 


' 1 E 1 

• 233 


/ 1 1 
o41i 


• 540 


.538 


£77 

• 537 


£7/ 

.,•534 


•493 


.446 


.096 


r-28 


.421 


.340 


i443 


• 226 




.523 


.536 


.543^ 


• 522 


• 508 


.449 


.096 


1-29 


t i i 

i466 


•350 


•470 


• 342 


• Ji6 


/OS 

• 4b? 


EC C 

• 353 


CAB 


• 3f< 


• 525 


.471 


.092" 


1-30 


.300 


.406 


•494 


• 367 


.514 


• 625 


•613 


.595 


•595 


.558 


•527 


A □ / - 

• 084 
















































.577 






.. HEAN 


.522 


.439 


.522 


.430 


.507 


^612 


.613 


• 606 


.613 






. .$..0. 


.1298 


•1362 


.1247 


.1667 


.1360 


• 1136 


.1124 


.1073 .1099 .1150 


































TABLE D-i 
ITEM P-VALUiS BY GROUP 
LETTER GROUPS 



ITEH 


AI 


AA 


MA 


PR 


OL 


OR 


NE 


MC 


MS 




MEAN 


S.U. 


I- I 


.826 


.802 


.808 


.843 


.766 


.920 


.918 


.926 


,902 


.919 


•864 


.057 


I- 2 


.466 


,494 


.502 


.456 


,533 


,659 


,708 


.664 


,649 


•656 


.579 


.092 


1-3 


.837 


.752 


.771 


.722 


.776 


.903 


,903 


.885 


,869 


.877 


.830 


,065 


I- 4 


.910 


,629 


.849 


,873 


,379 


,943 


.957 


.948 


.954 


.952 


.909 


,046 


I- 5 


,449 


,441 


.518 


.494 


,570 


.744 


.766 


,734 


.705 


,744 


.616 


,127 


I- 6 


,837 


.ao7 


.837 


,835 


.822 


.943 


,934 


.932 


,931 


.922 


.880 


.053 


I-»7 


.517 


.536 


.580 


.633 


.570 


,807 


.771 


.741 


.716 


,712 


.662 


.102 


I- 8 


.556 


,470 


.527 


.468 


.570 


.716 


,754 


.737 


,657 


.682 


•614 


,103 


I- 9 


.511 


.457 


,500 


,411 


.430 


.727 


.710 


• 700 


.670 


.697 


.588 


•115 


I-IO 


,685 


,719 


.747 


,722 


,720 


,869 


.876 


.866 


.860 


.850 


,791 


.075 


Ml 


.635 


.600 


.620 


.582 


.533 


.761 


.810 


.798 


•773 


.812 


.692 


• 103 


1-12 


.899 


,827 


.853 


,848 


,841 


.955 


,952 


.947 


.936 


,933 


•899 


,049 


1-13 


• 820 


,799 


.816 


.835 


.785 


,955 


.916 


.913 


,900 


.908 


•865 


.057 


I-H 


.522 


•486 


,571 


,468 


.505 


,778 


,776 


.739 


.731 


,744 


.632 


,125 


1-15 


.713 


.575 


.698 


.658 


.654 


•881 


.832 


,831 


.802 


.832 


,748 


,096 


1-16 


.618 


,557 


•598 


.46d 


,617 


.858 


.848 


,819 


.795 


,817 


.699 


.13,5 


I" 17 


.652 


,536 


.586 


,582 


.617 


.818 


,83^ 


• 821 


.801 


.806 


•706 


,115 


1-18 


.494 


.506 


.539 


.405 


,523 


.716 


.681 


.678 


.626 


.633 


,580 


,096 


1-19 


,393 


.342 


*382 


.266 


,3U 


.580 


•543 


• 555 


,534 


.546 


*446 


,111 






Sin 


.571 


.367 


.533 


,847 


.805 


,803 


.776 


,785 


.662 


.155 


1-21 


.461 


.327 


.376 


.278 


.430 


.693 


,649 


,625 


.607 


.612 


.506 


.141 


1-22 


.270 


.180 


.212 


.127 


,196 


,375 


,358 


,354 


.322 


,314 


.272 


• 083 


1-23 


.174 


,093 


.116 


#076 


,093 


.239 


.226 


,214 


• 181 


,231 


.164 


,061 


1-24 


.433 


.255 


.322 


.203 


,346 


.563 


.535 


,539 


.492 


•497 


.419 




1-25 


.303 


.200 


.198 


.101 


.215 


,426 


,392 


,416 


,349 


,348 


i295 


.105 


mill 


















,702 


.715 








.584 


.524 


,564 


.512 


.554 


,747 


.738 


.728 






S.D. 


,1959 


,2085 


.2059 


,2417 .2043 


.1850 


.1903 .1875 


,1976 


.1939 

































152 



III " • 


AT 

HI 




HA 


I- I 


.702 


,647 


♦ 641 


I- 2 

I L 


.72^ 


.679 


,718 


^ \ 


-730 


.663 


.733 




'i f U4 


t W J J 


.722 


1' 5 


i*TiQ 


• T J? 




i 0 




■ y wv 




l» 7 


iOG? 






I' 6 


A A C 






I- 9 


*607 






I- 10 


.466 


.373 


i43l 


1-11 




.350 


.420 


i-u 


.461 


#529 




1-13 








1-U 


.^67 


*4U0 




1-15 


.416 


1 ft c 

.395 


■ 353 


T 1 

I-lo 






■ J 7% 


1 1 f 




f tWW 


437 


1 18 


^ a B 


#3^9 




i * J Q 






.406 


1^20 










f £f3 




• 47U 


1-22 


.270 


.205 


,263 


1-23 


J53 


,199 


,218 


1-24 


,247 


.181 


.243 


1-25 


,264 


,243 


,286 




















.469 


.412 


,459 


S.D. ■ 


.1562 


.1532 


.149 



TABLE D-S 
\m P'VALUiS B¥ GROUP 
HATHEHATICS 













DO 


fii 


na 
















• 010 


f Q 1 ^ 


.881 


.868 


,868 




.757 


.824 


.790 


,761 


.ATI 


.729 


.852 


.872 


,855 


A71 




.830 


,836 


,848 




Ri4 


• B-^4 


.765 


,74' 

fin-. 


• 375 


i obi 


71 n 
t / iw 


fin7 

■ oU f 


fl3Q 


*544 


£ C3 

v3B9 


■ oli 






.418 


»421 


TEA 

•750 


•030 


• gJP 


.461 


,598 


.767 


.782 


• 763 


.354 


.421 


.773 


•645 






.467 


.580 


.63? 




.519 


,523 


,835 


.740 


Tin 


.329 


.514 


THE 

• 795 


■ f US 


4Pfl 


,468 


,589 


,744 


.723 


7 1 £5 

i7u 


,380 


,327 


,653 


•602 




,329 


,402 


,767 


.617 


• 3f4 


,291 


.477 


,784 


/En 




,278 


,299 


iS63 


• 587 


• 3/q 


i3Q4 


93U3 


iQiU 


9 J 11 




,266 


,355 


,619 


.646 


.640 


.203 


,355 


,676 


.545 


.517 










i J4? 


1 77 






*447 


i418 


.127 


.234 


.449 


.471 


,460 


,228 


.271 


,557 1 


•4?0 


.438 












,401 


.474 


,716 


.671 


,657 


.1663 


1 ,1514 


,1153 


.1232 


.129^ 


I mmm^m 











MS 






bfUf 












.oJo 


t iQQ 


f W ? 1 


7AA 


. f j3 




.043 


vOOi 


,q3U 


» 1 04 




ft ^ ^ 

*833 


,855 


744 
m foO 


iU/ f 


.755 


,742 


,619 




.782 


,782 


.684 


• 105 


.768 


,782 


,689 


.111 


,629 


,623 


,536 


,129 


.751 


.745 


,667 


,101 


.635 


«62n 


,535 


,135 


Ml 


,605 


,515 


,107 


jl3 


.726 


.633 


,121 


,659 


.655 


•566 


• 145 


,685 


,711 


.613 


• US 


.573 


.567 


.487 


.116 


.609 


.563 


,466 


•152 


.629 


.613 


.533 


.141 


.542 


.552 


.446 


.122 


.551 


.544 


•489 


■ 111 


.613 


.608 


•478 


.150 


.503 


.463 


•402 


• l94 


.436 


.506 


•399 


1 AO 


.413 


.404 


.327 


.120 


.439 


,433 


.328 


.127 


.421 


.389 


.357 


.107 

mmmmm*. 


.643 


,637 






.1302 


,1354 













ERIC 



154 



TABLE D-6 

ITEM P-VALUES BY GROUP 
HOSAIC CCHPARISONS 



ITEM 


Al 


AA 


HA 


PR 


01 


OR 


HE 




HS 


1 ii 1 


MEAN 


S.D. 


























I- I 


.910 


,838 


,904 


,873 


,879 


,943 


,941 


.943 


,936 


,948 


,912 


• 036 


I- 2 


.904 


,848 


• 900 


.899 


.907 


.972 


,943 


.946 


,947 


,943 


.921 


,034 


I- 3 


>m 


.822 


.871 


,823 


,869 


,898 


,920 


,932 


.918 


.922 


•883 


#039 


I- 4 


• S4i 


,795 


,851 


.848 


.822 


.926 


•927 


,931 


,916 


♦929 


,879 




I- 5 


,910 


.834 


,890 


,873 


,897 


,943 


,944 


,953 


,944 


.952 




•033 


I- 6 


,910 


.828 . 


,896 


.861 


,841 


.960 


•944 


• 953 


,941 


•945 


•908 


• 047 


I- 7 


,904 


,830 


,900 


,899 


.822 


.972 


,951 


,959 


,948 


,956 


.914 


API 

,051 


I- 8 


,882 


,767 


,841 


,823 


.850 


.932 


.927 


.944 


,928 


,927 


,882 


•056 


I- 9 


.848 


.713 


.814 


.734 


,794 


,943 


,908 


,917 


,895 


,907 


.847 


,076 


MO 


,826 


.637 


,769 


.671 


.813 


.903 


.864 


,888 


,866 


,868 


,311 


,087 


I-il 


.781 


.580 


,761 


,557 


,720 


,681 


.860 


,887 


.855 


•859 


.774 


.115 


1-12 


,736 


.514 


.682 


.468 


,645 


,886 


.817 


,846 


,810 


,811 


,722 


• 135 


1-13 


,719 


,483 


.647 


,418 


*579 

9^1? 


9QJQ 


.781 


,814 


,773 


,791 


,686 


,142 


1-14 


.640 


.403 


,557 


,392 


,486 


,818 


,706 


.747 


,703 


.717 


.617 


• 141 


1-15 


•522 


,307 


,473 


,316 


.421 


,744 


,620 


.660 


,618 


.651 


.534 


,143 




.427 


,246 


.380 


,253 


.346 


,670 


,512 


,555 


.520 


,538 


.445 


.131 


1-17 


,360 


.207 


.337 


.190 


,271 


,585 


,437 


,470 


.443 


,467 


,377 


,121 


1-18 


.303 


,143 


,220 


,063 


.196 


.489 


•306 


.359 


.324 


,346 


,275 


• 116 


1-19 


.213 


.122 


.157 


,051 


;159 


,432 


.237 


,265 


.263 


•272 


•217 


•099 


1-20 


.180 


,095 


.131 


.051 


.112 


,341 


.179 


,204 


.210 


.209 


,171 


•077 


HiAN 


.684 


,551 


.649 


.553 


,621 


.805 


,736 


,759 


,738 


,748 








,2476 ,2718 .2642 


,3076 


,2699 ,1905 


.2541 .2442 .2444 


,2415 



























o 

ERLC 



APPENDIX E 
I tern Deltas 



ERIC 



ITtH 



TABLE E-1 

I TEH DELTAS BY GROUP 
VQCAeULARf 



M AA jA PR OL OR «E «C 1 ^^^^,1±, 



8i97 1.37 



-12 17.02 n.06 17.20 17.34 17.52 14.20 14.82 • ' '* " 

IS:iii::ritSli:S!i:;»i;:!Sl"H!: 

H5 15.52 n.Ol 16.14 15.32 i^'^^^l^f jj^^l^ 

Iff^ 14-35 15.01 14.73 14.86 14.00 12.77 11.97; 12.52 12.19 ^ 
S! i!7f3 1.776 2.50n_.92n.W 

r»#riTrOELI»S COHPUTEO ONLY IF a) .05j P 1 

MC 12 MORE THAN 50J OF THE GROUP RESPONOEP TO THE ITEH 



ITfcM 



mH,E-2. 

ITEM DELTAS 8t GROUP 
PICTURE'NUHBER 



' __ niw — 

AA HA PR OL OR WE riC HS WW NEAN S*0. 



I- 1 12.03 12.06 11.45 12.04 12.10 10.98 10.71 11.18 10.94 11.31 11.49 0.50 

I- I 11.07 12.07 11.04 il.aS 10,89 9.93 lO.Of 9,99 9.94 10.30 \%M 0.68 

I- 3 10.20 11.01 lO.OS Ifl.lB i0.2l 10,01 9.60 9.75 9,55 9.78 10.04 0,41 

I- 4 11.92 12.77 11.65 12.30 11.81 U.S5 10.S7 10.97 10,93 11.22 11,60 0.19 

i. 5 14,44 14.87 lp.74 15.10 13.71 13,34 13,24 13,24 12,96 13,69 13,87 0,77 

I- 6 14.02 14.80 13,93 15.01 14,29 13.17 13.24 13.30 13,18 13.58 13,86 0.61 

1- 7 11.86 12.84 11.69 12.43 11.31 11.05 10,43 10.69 10,48 16.96 il.3T 0.78 

1- 8 12.94 13.81 12.43 13,70 12,77 11.36 11.99 11.94 11.76 12.09 12.48 0.77 

V 9 13.28 m** 13.S5 14.09 14,69 12,83 12.94 12,70 12.78 12.89 13,31 0.6§ 

MO 13.85 13,78 ***** 14.69 13,17 12.80 12,86 12.75 13,37 13,41 0.62 

I-U 13.51 *m* 13.78 *»*** 13,42 12.20 12.49 12.65 12.72 13,03 12.98 0.52 

1-12 14,10 ***** ***** ****M3.46 13.16 13.19 13.46 0.37 

1-13 I3a7 ***** ***** **«*13»52 11^ 11,91 12.03 12.25 12,41 12,38 0,69 

[-14 ***** *****^*** »*♦** ***** 11.79 12,25 U 12,35 0.33 

1^15 ft«*« »**«*.****« ********** 12.49 12.98 12,86 13.05 13.24 12.92 0,25 

1-16 10.94 11,25 11.36 10.95 11.00 9,93 10.36 10.42 10,20 10.67 10.71 0.45 

1-17 11.92 13c09 12,32 13.32 12.29 11.91 11.21 11,57 11,30 11.79 12.07 0.67 

1-18 8.26 9.36 8.84 8,18 8.51 8.17 7,86 8,44 8,24 8.41 8*j| 

1-19 13,11 13.12 12.88 13,57 13,14 11,67 11.84 12,03 11,82 12,27 12.54 0,66 

1-20 12,49 13.42 12.98 14,49 13.42 12,49 12.29 12.51 1245 12.78 12.91 0.67 

i-21 12,55 12.85 12,11 13,19 12.48 a.42 11.57 11,29 11.42 11,89 12,08 0.63 

1-22 12.09 12.89 12.49 13.44 12.20 11,17 11,37 11.50 11.34 11,90 12.04 0,70 

1.23 12,83 13,96 13.08 15.20 13,33 11.55 12,26 U.99 11,9^ 12.53 12.87 1.04 

1-24 11,26 12,61 11,41 12,43 11.91 10,44 10,44 10,56 10.57 10.90 11,25 0.78 

1-25 15.19 15.71 14.82 *»•** 15.11 14.45 14.22 14.29 14.09 14.48 14,71 0,51 

1-26 12.66 14.02 12.69 13.70 12.67 U,91 11.91 11.88 11.90 11.98 12,53 0,74 

,,P7 13,68 «**** 13.99 *»•** 13.90 12.60 12,62 12.62 12.66 13.05 13.14 0,57 

-28 13.19 **»«* 13.57 ***** 13.71 12.77 12.64 12.57 12.78 12.92 13,09 0.47 

1-29 13.34 «»»• 13.22 14.63 14,69 13.11 12.15 12.31 12,28 12,75 13.16 0,90 

1-30 13.00 ***** 13,06 ***** 12.86 11,73 11.80 12,04 12.04 12,42 l^*37J.5i^ 

S 12.63 12,97 12.54 12.98 12.76 11.80 11,78 11.86 11,79 12.17 

S.O. 1.403 1.434 1,315 1.781 1.489 1,277 1,290 1.207 ^^46 1.275 ^^^^^^^^^^^^^ 

***** \m DELTAS COMPUTiO ONLY If II) ,05 I P i S\ 

AND 12) HORE THAN 501 OF THE GROUP RESPONDED TO THE ITEM 



' TABLK E-3 
ITfeH DELTAS BV ^OUP, 
READING 



H U HA PR OL OR « NC HS ««_ 



.72 15.115 13.80 11.17 10.97 11.10 U.17 11.08 12.5 UV> 
- . 0 16.H n.ll 16.5U4.0V 13.51 13.58 13.69J3.42 ..-lyJJ' _ 



HEAN 
S.O. 



13 63 14.13 13.90 14.01 13.86 U.94 11.60 U*89 11.89 11.76 



i***riTEH DELTAS COHPUTEO OfiLr IF 1 P 1 .95 /^^^ _^ 

m (2) HORI THAN 501 OF THE GROUP RESPONDED TO THE ITEH 



ITEM 



ITEN DELTAS BV GROUP 
LETTER GROUPS • 

HI AA . HA . PR OL OR NEAN : S.D. 



i- 1 9.2S 9,61 9.52 8,8M0.09 7.37=1.41 7.20 7.82 7,40 8.46 1.06 

I- a 13.34 13.06 12,98 13.44 12.67 11,36 10.81 U.31 U.47 11.39 12.18 0.95 

I- 3 9,07 10.28 10.03 10.65 9.97 7.79 7.81 ,8.19 6.52 B.3S .9.07 1.03 

7.63 9.20 8.87 8.43 8.33 6,67 6,48 «*»* .7.95 0,98 

\- 5 13.B1 13.59 12.82 13.06 12.29 10.37 lO.lQ 10,50 10.85 10.38 11.75 1.36 

1-6 9.07 9.54 9.08 9.10 9.30 6.67 6.98 7.03 7.06 7.31 8.111.12 

I- 7 12.83 12.64 12.20 11.64 12.29 9.54 10.03 10.42 10.72 10.26 11.26 1.14 

-I- 8 12.44 13.30 12.73 13.32 12.29 10.72 10.25 10.47 11,3.9 JLH 11.80 1.10 

1^ 9 12.89 13.43 13,00 13.19 13.71 10.58 10.79 10.91 11.24 10.94 12.07 1.20 

1-10 ll,C7 10.68 10.34 10.65 10.67 8,51 8.38 8.56 8.67 8.85 9.64 1.06 

Ml U.62 11.99 11.78 12,17 12.67 10.16 9.49 9.66 10.00 9.47 10.90 1.19 

1-12 7.90 9.24 8,80 8,89 9,00 *»***•**«♦ 6,53 .6.90 7,02, 8.04 1,02 

1-13 9.34. 9.65 9,39 9.10 9,84 ***** 7,48 7,55 7.87 7.68 8.66 0.93 

1-14'^ "ilM '13. 14 12.28 13.32 12,95 9.93 9.97 10.44 .10.54 10.38 11.57 1.36 

1-15 10.75 12.24 10.93 11.37 11,41 8.29 9.15 9117 9.60 9,15 10.21 1.23 

1-16 lUaO 12.43 12.01 13.32 li.8i 8,72 8,89 9.35 9,70 9,38 10,74 1.60 
^I.-.L7-=:--^=l-M4=12*6442a44i.iiaU8L_^ 

M8 13.G6 12.94 12.61 13.96 12.77 10.72 II.II 11.15 11.71 11.64 12.17 0,99 

1-19 14.06 14.62 14,20 15.50 14,89 12.20 12,57 12,45. 12.66 12.53 li,57.1.i5 

h20 11.74 12.90 12.28 14.36 12,67 8.91 9,57. 9.58 9.97 9,84 11.18 1,74 

h2l 13,39 14,79 14.27 15,35 13.71 10,98 11.47 11,73 11.92 11.86 12,95 1.46 

I-ZZ-.. 15,45 16.67 16.19 •*»♦* 16,42 14.27 14.45 14.49 14.34 14.82 15.29 0.87 

1-23' 16.75 18.29 17.77 ***** 18.28 15.84 16,0116,17 16,64 13,94 16,86 0,95 

1-24 13.68 15.63 14,84 ***** 14,59 12,31 12.65 12.61 13.08 13,03 13,60 1.09 

1-25 15,06 ***** 16.40 ***** 16.16" 13.74 14.10 13,34 14,55 ^^•56^___^^^^^*1^_ 

S 12,00 12.60 12,3041.99 12.42 10,22 10.37 10.20 10.72 10,54 

s'c. 2.290 2.321 2.360 2.137 2.367 2.307. 2.292 2,423 2.39? 2.350 

.*M** (TEN DELTAS COHPUTID ONLV IF (U Mi P £ .95 

AND (2) HORI THAN 501 OF TH.t GkOUP RISPONOED TO THfc-ITEH . 



TABU E-3 
im DELTAS BY GROUP 
MATHEMflCS 



ITtH 



' 1 

- 2 

r. 3 

- 4 

-.5 

- 6 

- 7 

■ 8 

- 9 
-10 



-il 

*ll 

-13; 

-14 

-15 

-16 

-I? 
-18 

-19- 
-20 
-21 

1-21 

-Ik 

MEAN 



'AI ' AA • HA pa OL 



OR HE ' WC NS 



10.88 
.10.61 
10,55 

lo.iS 

13.83, 
1U56 
11.26 
13.i»i 
11.92 
13.34 

im 

13.39 
13.39 
12.32 
13.85 
14.99 
13.73 
14.14 
14.08 
14.20 
15.39 
15.45 
15.66 
15.73 
15.52 



11.49' 
41.15- 
11.32 
11.43 
13.41 
12.39 
12.47'. 

12.37 
14,30 

12.71 
14,07 
14.01 
14.07 
15.09 
14.01 
14.77 
14.42 
15.05 
16.44 
16,29 
16.3S 
16.64 
15.78 



11,56 10.95 
10,69 11.09 

10.52 iit23 
10,64 11.23 
12.92 13.70 
12.30 12.04 
12.36 12.56 
13.91' 13.83 
11,82 13,19 
13.T0 14.49 
T37ffri:4T49" 
12.38 12.81 
13.33 14.77 
12.T3 13,32 
14.48 14.22 
14.08 14.77 
13.64 15.20 
14.62 15.35 
13,95 15,05 
14,57' 15.50 
15.21 16.33 

15.53 15.98 
16.11 1^.70 
15.79 17.57 
15.26 15.98 



11.21 8.29 5.52 8.52 

lO.Ei 9.28 9.77 10.17 

10.56 8.82 a.« 8«77 

10,78 '9.19" 1.09 8.88 

12.86 8,82 10.11 10.35 

12.39 10.79 9.53 9.19 

12.10 9.45 9,51 9,59 

13.80,10,10 11.39 11.62 

12.01 10.08 9,89 10.14 

13.80 Ifl.Ql 11.51 11.6^ 
i3TW-l^.-2H-K60~ttf fel- 
la.?? 9.10 10,41 10.69 
12.86 9,70 10,84 11.13 

12.10 10.37 10,64 10.68 
14.?9 11,42 11.97 11.99 
U,99 10.08 11,81 12.25 
13.23 9,86 11,46 11,76 

15.11 12.37 12.13 12.23 
12.95 11.24 12.21 12.20 
14.48 11.79 11.50 11.57 
14.48 11.17 12.55 12.83 
14.69 11.55 12.66 12.75 
16.16 12.77.13.53 13,83 
15.91 13.51 13.29 13.40 
15.44 12.43-13.30 13.62 



10.09 
8.63 
9.14 
10.24 
9.88 
10.07 
11.68 
10.29 

11. M 
44. 
10.76 
11.36 
11.07 
12,27 
11.90 
11.69 
12,58 
12.49 
11.85 
12.97 
13.14 
13.88 
13.61 
13,79 



9.09 
10.27 
8.86 
8.76 
10.41 
9,88 
9,89 
11.75 
10.36 
11.78 



^7 

10,60 
11.40 
10.78 
12.33 
12.36 
11.85 
12.48 
12.55 
11,90 
13.37 
12.94 
13,97 
13.68 
14.11 



NEAN S.D. 

9.-94 Ul 
10.33 0.54 

9.77 1.10. 
10.00 1.02 
ll.,67 1,76 
11.00 1,22 
10.93 1.28 
12.62 1.34 
11.21 1.12 
12.62:1.41 

11,56 1.34 
12.29 1,54 
11.80 1,21 _ 
13.14 1.19 
13.13 1.60 
12.64 1.50 
13.58 1.26 
13.11 1.14 
13.24 1.56 
14.08 1.61 
14.10 1.59: 

14.90 1.36 

14.91 1.50 
14.53 1.16; 



S 13.33 l3.9nMUU9 U.28.10.5e 11.11 U.J^U^^^ 
S.O. 1.648 1.65* 1.585 1.8Z4 1.607 .1.377,1.W3,1.W l.*78. l.Sif 





, ■ TABLE :S.6 

ITEH Oatm BY GROUP 
HOSAIC CQNPArliONS 



ITEH n NA PR OL OR HE «C ■ HS ■ WW-^- 

I- 1 . . 7.63 9.0i hU 8.43 8.33 6.67 6.75 6,69 6.84 6.48 7.46 0.86 

1- 2 , 7.7', 8.88 7.B7 7.90 7.72 6.67 6.56 6.!2 6.67 7.40 0.78 

1-3: 8.79 9.31 ■8.47 9.30 8.51 7,92 7.37 7.04 7.43 7.31 8,15 0.80 

1- 4 8.88 9.70 8.84 8,89 9.30 7,21 7,18 7.07. 7.48 7.13 8,17 0,99 

1- 5 7.63 9,13 8,10 8,43 7.94 6.67 6.63 *♦•♦» 6.65 7,65 0.87 

1-6 7.63 9.21 7.96 8,66 9,00 ***«• 6.63 ***** 6,76 6,61 7,811.01 

1*7 ' 7.77 9,19 7.87 7,90 9.30 »*♦♦* ****« •«••♦ 6.49 8,09 0.95 

1- 8 8.26 10.08 9,01 9,30 8,85 7.04 . T.17 6,65 7,15 T.l'l 8.07 1.12 

h9 ' 8.88 10,75 9.43 10,50 9m 6.67 7.68 7.47 7.99 7,71 . 8.68 1.31 

I-IO 9.25 11.60 10,05 11,23 9,44 7.79 8.61 8.13 8.56 8.5,4 9.32 1.22 

I-U 9.90 U,20 10,16 12.43 10.67 8.29 8.67 . 8,17 8,77 B,7p 9,80 1,48 

1-12 ' ,10.48 12,86 11.11 13.32 11.52 8.17 9.39 8.92 9.49 ViUT 10.47 1.62 

1-13 1C.68 13.17 11,49 12.20 8.72 9.90 9.42 10,00 9.76 10,59 1.35 

1-14 11,56 **«*• 12.43 *»♦** 13,14 9.37 10.83 10,34 10.87 10,71 U.U 1.12 

1-15 12.78 ***** 13,27 »«**• ***** 10.37 11.78; 11.35 11.80 il.4;3 11.83 0.88 

|.17 ««««« $tm ***** ♦♦♦♦* ***** 12,14 ***** 13.30 *♦«» «**» 12,72 0.58 

1-13 , #**,* .♦**♦♦ ***** 13,11 ***** ***** »**** *W 13.110.0 

J. 19 mt* ***** ***** ***** ***** ***** *****. ^*** ;^**|* . 

1-20 m** #******** ******************** **^*^ ***** 0.0 0.0 



fififlUE 

MEAN 9.19 10.39 9.59 9.69 9.69 8.76 8,54. 8.83 8,48 - 8.59 
S.O. 1.536 1,492 1,718 1.714 1.564 2.003 1.949 2.164 1,933 1.881 

***** ITEH DELTAS COMPUTEO ONLY IF (1) .Oi i P S .95 

AND 12) MORE THAN 501 OF THE GROUP RiSPONDED TO THE ITEM 



